Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

PAPI software-defined events for in-depth performance analysis

The methodology and standardization layer provided by the Performance Application Programming Interface (PAPI) has played a vital role in application profiling for almost two decades. It has enabled sophisticated performance analysis tool designers and performance-conscious scientists to gain insights into their applications by simply instrumenting their code using a handful of PAPI functions that “just work” across different hardware components. In the past, PAPI development had focused primarily on hardware-specific performance metrics. However, the rapidly increasing complexity of software infrastructure poses new measurement and analysis challenges for the developers of large-scale applications. In particular, acquiring information regarding the behavior of libraries and runtimes—used by scientific applications—requires low-level binary instrumentation, or APIs specific to each library and runtime. No uniform API for monitoring events that originate from inside the software stack has emerged. In this article, we present our efforts to extend PAPI’s role so that it becomes the de facto standard for exposing performance-critical events, which we refer to as software-defined events (SDEs), from different software layers. Upgrading PAPI with SDEs enables monitoring of both types of performance events—hardware- and software-related events—in a uniform way, through the same consistent PAPI. The goal of this article is threefold. First, we motivate the need for SDEs and describe our design decisions regarding the functionality we offer through PAPI’s new SDE interface. Second, we illustrate how SDEs can be utilized by different software packages, specifically, by showcasing their use in the numerical linear algebra library MAGMA-Sparse, the tensor algebra library TAMM that is part of the NWChem suite, and the compiler-based performance analysis tool Byfl. Third, we provide a performance analysis of the overhead that results from monitoring SDEs and discuss the trade-offs between overhead and functionality.

Jagode, Heike↗

Simplifying Performance Analysis of Large-scale Adaptive Scientific Applications

Performance analysis of parallel scientific codes is becoming increasingly difficult due to the rapidly growing complexity of applications and architectures. Existing tools fall short in providing intuitive views that facilitate the process of performance debugging and tuning. In this paper, we exploit a recent idea of projecting and visualizing performance data on the communication and hardware domain for faster, more intuitive analysis of applications. We leverage several performance analysis and visualization tools to showcase the discovery of scalability bottlenecks in a structured AMR library. Using novel techniques to project per-phase timing data, application data, and communication data on a communication graph, we identify a previously elusive scaling bottleneck in the library. We present solutions that mitigate this problem, resulting in 22% improvement in the performance for a 65,536-core run on an IBM Blue Gene/P system.

97 MATHEMATICS AND COMPUTING↗

Performance Analysis of Deep Learning Workloads on Leading-edge Systems

This work examines the performance of leading-edge systems designed for machine learning computing, including the NVIDIA DGX-2, Amazon Web Services (AWS) P3, IBM Power System Accelerated Compute Server AC922, and a consumer-grade Exxact TensorEX TS4 GPU server. Representative deep learning workloads from the fields of computer vision and natural language processing are the focus of the analysis. Performance analysis is performed along with a number of important dimensions. Performance of the communication interconnects and large and high-throughput deep learning models are considered. Different potential use models for the systems as standalone and in the cloud also are examined. The effect of various optimization of the deep learning models and system configurations is included in the analysis.

97 MATHEMATICS AND COMPUTING↗

Traveler: Navigating Task Parallel Traces for Performance Analysis

Understanding the behavior of software in execution is a key step in identifying and fixing performance issues. This is especially important in high performance computing contexts where even minor performance tweaks can translate into large savings in terms of computational resource use. To aid performance analysis, developers may collect an execution trace —a chronological log of program activity during execution. As traces represent the full history, developers can discover a wide array of possibly previously unknown performance issues, making them an important artifact for exploratory performance analysis. However, interactive trace visualization is difficult due to issues of data size and complexity of meaning. Traces represent nanosecond-level events across many parallel processes, meaning the collected data is often large and difficult to explore. The rise of asynchronous task parallel programming paradigms complicates the relation between events and their probable cause. Here, to address these challenges, we conduct a continuing design study in collaboration with high performance computing researchers. We develop diverse and hierarchical ways to navigate and represent execution trace data in support of their trace analysis tasks. Through an iterative design process, we developed Traveler , an integrated visualization platform for task parallel traces. Traveler provides multiple linked interfaces to help navigate trace data from multiple contexts. We evaluate the utility of Traveler through feedback from users and a case study, finding that integrating multiple modes of navigation in our design supported performance analysis tasks and led to the discovery of previously unknown behavior in a distributed array library.

97 MATHEMATICS AND COMPUTING↗

Internet Performance Analysis of South Asian Countries Using End-to-End Internet Performance Measurements

Internet performance is highly correlated with key economic development metrics of a region. According to World Bank, the economic growth of a country increases 1.3% with a 10% increase in the speed of the Internet. Therefore, it is necessary to monitor and understand the performance of the Internet links in the region. It helps to figure out the infrastructural inefficiencies, poor resource allocation, and routing issues in the region. Moreover, it provides healthy suggestions for future upgrades. Therefore, the objective of this paper is to understand the Internet performance and routing infrastructure of South Asian countries in comparison to the developed world and neighboring countries using end-to-end Internet performance measurements. The South Asian countries comprise nearly 32% of the Internet users in Asia and nearly 16% of the world. The Internet performance metrics in the region are collected through the PingER framework. The framework is developed by the SLAC National Accelerator Laboratory, USA and is running for the last 20 years. PingER has 16 monitoring nodes in the region, and in the last year PingER monitors about 40 sites in South Asia using the ubiquitous ping facility. The collected data is used to estimate the key Internet performance metrics of South Asian countries. The performance metrics are compared with the neighboring countries and the developed world. Particularly, the TCP throughput of the countries is also correlated with different development indices. Further, worldwide Internet connectivity and routing patterns of the countries are investigated to figure out the inconsistencies in the region. Furthermore, the performance analysis revealed that the South Asia region is 7-10 years behind the developed regions of North America (USA and Canada), Europe, and East Asia.

97 MATHEMATICS AND COMPUTING↗

Building a Community Infrastructure for Scalable On-Line Performance Analysis Tools around Open|SpeedShop

In this project we created a community tool infrastructure for program development tools targeting Petascale class machines and beyond. This includes tools for performance analysis, debugging, and correctness tools, as well as tuning and optimization frameworks. The developed infrastructure provides a comprehensive and extensible set of individual tool building components. We started with the basic elements necessary across all tools in such an infrastructure followed by a set of generic core modules that allow a comprehensive performance analysis at scale. Further, we developed a methodology and workflow that allows others to add or replace modules, to integrate parts into their own tools, or to customize existing solutions. In order to form the core modules, we built on the existing Open|SpeedShop infrastructure and decomposed it into individual modules that match the necessary tool components. At the same time, we addressed the challenges found in performance tools for petascale systems in each module. When assembled, this instantiation of community tool infrastructure provides an enhanced version of Open|SpeedShop, which, while completely different in its architecture, provides scalable performance analysis for petascale applications through a familiar interface. This project also built upon and enhances capabilities and reusability of project partner components as specified in the original project proposal. The overall project team’s work over the project funding cycle was focused on several areas of research, which are described in the following sections. The reminder of this report also highlights related work as well as preliminary work that supported the project. In addition to the project partners funded by the Office of Science under this grant, the project team included several collaborators who contribute to the overall design of the envisioned tool infrastructure. In particular, the project team worked closely with the other two DOE NNSA laboratories Los Alamos and Sandia leveraging co-funding for Krell by ASC’s Common Computing Environment (CCE) program as laid out in the original proposal. The ASC CCE co-funding, coordinated through LLNL, was for 50% of the total project funding, with the ASC CCE portion of the funding going entirely to Krell, while the ASCR funding itself was split between Krell and the funded partners. This report covers the entire project from both funding sources. Additionally, the team leveraged the expertise of software engineering researchers from Carnegie Mellon University, who specialize in software framework design, in order to achieve a broadly acceptable component framework. The Component Based Tool Framework (CBTF) software has been released to the community. Information related to the project and the released software can be found on the CBTF wiki page at: http://sourceforge.net/p/cbtf/wiki/Home.

97 MATHEMATICS AND COMPUTING↗

Performance Analysis: ITS Data through September 30, 2009

Data from ITS was analyzed to understand the issues at LLNL and to identify issues that may require additional management attention and these that meet the threshold for reporting to the DOE Noncompliance Tracking System (NTS). In this report we discuss assessments and issues entered in ITS and compare the number and type presently entered in ITS to previous time periods. Issues reported in ITS were evaluated and discussed. The analysis identified two noncompliances that meet the threshold for reporting to the DOE NTS. All of the data in ITS is analyzed; however, the primary focus of this report is to meet requirements for performance analysis of specific functional areas. The DOE Office of Enforcement expects LLNL to 'implement comprehensive management and independent assessments that are effective in identifying deficiencies and broader problems in safety and security programs, as well as opportunities for continuous improvement within the organization' and to 'regularly perform assessments to evaluate implementation of the contractor's's processes for screening and internal reporting.' LLNL has a self-assessment program, described in the document applicable during this time period, ES&H Manual Document 4.1, that includes line, management and independent assessments. LLNL also has in place a process to identify and report deficiencies of nuclear, worker safety and health and security requirements. In addition, the DOE Office of Enforcement expects that 'issues management databases are used to identify adverse trends, dominant problem areas, and potential repetitive events or conditions' (page 15, DOE Enforcement Process Overview, June 2009). LLNL requires that all worker safety and health and nuclear safety noncompliances be tracked as 'deficiencies' in the LLNL Issues Tracking System (ITS). Data from the ITS are analyzed for worker safety and health (WSH) and nuclear safety noncompliances that may meet the threshold for reporting to the DOE Noncompliance Tracking System (NTS). This report meets the expectations defined by the DOE Office of Enforcement to evaluate implementation of internal processes for screening and reporting, review the assessments conducted by LLNL, analyze the noncompliances found in these assessments, and evaluate the data in the ITS database to identify adverse trends, dominant problem areas, and potential repetitive events or conditions. The report attempts to answer three questions: (1) Is LLNL evaluating its programs and state of compliance; (2) What is LLNL finding; and (3) Is LLNL appropriately managing what it finds? The results from analyzing the deficiencies are presented in accordance with the two primary NTS reporting thresholds for WSH and nuclear safety noncompliances: (1) those related to certain events or conditions and (2) those that are management issues. In addition, WSH noncompliances were also analyzed to determine if any fell under the 'other significant condition' threshold. This report identifies deficiencies that meet the criteria for reporting to the DOE NTS; topics and subtopics that should remain under observation because the number of entries meets the test criteria or because of management concern; and topics and subtopics that are determined to no longer require observation. Topics and subtopics that are identified for continued observation are placed on a 'watch list.' The purpose of the watch list is for the Performance Analysis and Reporting Section (PARS) of the Contactor Assurance Office to analyze these topics and subtopics in future performance analysis reports.

99 GENERAL AND MISCELLANEOUS↗

A mono-dimensional nuclear fuel performance analysis code, PUMA, development from a coupled approach

Multidimensional-multi-physical phenomena in nuclear fuels are treated as a set of mono-dimensional-coupled problems which encompass heat, displacement, fuel constituent redistribution, and fission gas release. Rather than uncoupling these coupled equations as in conventional fuel performance analysis codes, efforts are put into to obtain fully coupled solutions by relying on the recent advances of numerical analysis. Through this approach, a new SFR metal fuel performance analysis code, called PUMA (Performance of Uranium Metal fuel rod Analysis code) is under development. Although coupling between temperature and fuel constituent was made easily, the coupling between the mechanical equilibrium equation and a set of stiff kinetics equations for fission gas release is accomplished by introducing one-level Newton scheme through backward differentiation formula. Displacement equations from 1D finite element formulation of the mechanical equilibrium equation are solved simultaneously with stress equation, creep equation, swelling equation, and FGR equations. Calculations was made successfully such that the swelling and the hydrostatic pressure are interrelated each other. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Connecting Performance Analysis and Visualization to Advance Extreme Scale Computing

In the first week of January 2014 Dagstuhl hosted a Perspectives Workshop on “Connecting Performance Analysis and Visualization to Advance Extreme Scale Computing”. The event brought together two previously separate communities – from Visualization and HPC Performance Analysis – to discuss a long term joined research agenda. The goal was to identify and address the challenges in using visual representations to understand and optimize the performance of extreme-scale applications running on today’s most powerful computing systems like climate modeling, combustion, material science or astro-physics simulations.

97 MATHEMATICS AND COMPUTING↗

Performance Analysis: Work Control Events Identified January - August 2010

This performance analysis evaluated 24 events that occurred at LLNL from January through August 2010. The analysis identified areas of potential work control process and/or implementation weaknesses and several common underlying causes. Human performance improvement and safety culture factors were part of the causal analysis of each event and were analyzed. The collective significance of all events in 2010, as measured by the occurrence reporting significance category and by the proportion of events that have been reported to the DOE ORPS under the ''management concerns'' reporting criteria, does not appear to have increased in 2010. The frequency of reporting in each of the significance categories has not changed in 2010 compared to the previous four years. There is no change indicating a trend in the significance category and there has been no increase in the proportion of occurrences reported in the higher significance category. Also, the frequency of events, 42 events reported through August 2010, is not greater than in previous years and is below the average of 63 occurrences per year at LLNL since 2006. Over the previous four years, an average of 43% of the LLNL's reported occurrences have been reported as either ''management concerns'' or ''near misses.'' In 2010, 29% of the occurrences have been reported as ''management concerns'' or ''near misses.'' This rate indicates that LLNL is now reporting fewer ''management concern'' and ''near miss'' occurrences compared to the previous four years. From 2008 to the present, LLNL senior management has undertaken a series of initiatives to strengthen the work planning and control system with the primary objective to improve worker safety. In 2008, the LLNL Deputy Director established the Work Control Integrated Project Team to develop the core requirements and graded elements of an institutional work planning and control system. By the end of that year this system was documented and implementation had begun. In 2009, training of the workforce began and as of the time of this report more than 50% of authorized Integration Work Sheets (IWS) use the activity-based planning process. In 2010, LSO independently reviewed the work planning and control process and confirmed to the Laboratory that the Integrated Safety Management (ISM) System was implemented. LLNL conducted a cross-directorate management self-assessment of work planning and control and is developing actions to respond to the issues identified. Ongoing efforts to strengthen the work planning and control process and to improve the quality of LLNL work packages are in progress: completion of remaining actions in response to the 2009 DOE Office of Health, Safety, and Security (HSS) evaluation of LLNL's ISM System; scheduling more than 14 work planning and control self-assessments in FY11; continuing to align subcontractor work control with the Institutional work planning and control system; and continuing to maintain the electronic IWS application. The 24 events included in this analysis were caused by errors in the first four of the five ISMS functions. The most frequent cause was errors in analyzing the hazards (Function 2). The second most frequent cause was errors occurring when defining the work (Function 1), followed by errors during the performance of work (Function 4). Interestingly, very few errors in developing controls (Function 3) resulted in events. This leads one to conclude that if improvements are made to defining the scope of work and analyzing the potential hazards, LLNL may reduce the frequency or severity of events. Analysis of the 24 events resulted in the identification of ten common causes. Some events had multiple causes, resulting in the mention of 39 causes being identified for the 24 events. The most frequent cause was workers, supervisors, or experts believing they understood the work and the hazards but their understanding was incomplete. The second most frequent cause was unclear, incomplete or confusing documents directing the work. Together, these two causes were mentioned 17 times and contributed to 13 of the events. All of the events with the cause of ''workers, supervisors, or experts believing they understood the work and the hazards but their understanding was incomplete'' had this error in the first two ISMS functions: define the work and analyze the hazard. This means that these causes result in the scope of work being ill-defined or the hazard(s) improperly analyzed. Incomplete implementation of these functional steps leads to the hazards not being controlled. The causes are then manifested in events when the work is conducted. The process to operate safely relies on accurately defining the scope of work. This review has identified a number of examples of latent organizational weakness in the execution of work control processes.

99 GENERAL AND MISCELLANEOUS↗

Empirical Performance Analysis of HPC Applications with Portable Hardware Counter Metrics [Thesis]

In this dissertation, we demonstrate that it is possible to develop methods of empirical hardware-counter-based performance analysis for scientific applications running on diverse types of CPUs. Although hardware counters have been used in performance analysis for at least 30 years, the methods used are still limited to particular CPU vendors or even particular generations of CPUs from the same vendor. Our motivating hypothesis is that hardware counter-based measurements could be developed to provide consistent performance information on diverse CPU types. This dissertation proves the hypothesis was correct by demonstrating one such set of metrics.

97 MATHEMATICS AND COMPUTING↗

PATHA: Performance Analysis Tool for HPC Applications

Large science projects rely on complex workflows to analyze terabytes or petabytes of data. These jobs are often running over thousands of CPU cores and simultaneously performing data accesses, data movements, and computation. It is difficult to identify bottlenecks or to debug the performance issues in these large workflows. In order to address these challenges, we have developed Performance Analysis Tool for HPC Applications (PATHA) using the state-of-art open source big data processing tools. Our framework can ingest system logs to extract key performance measures, and apply the most sophisticated statistical tools and data mining methods on the performance data. Furthermore, it utilizes an efficient data processing engine to allow users to interactively analyze a large amount of different types of logs and measurements. To illustrate the functionality of PATHA, we conduct a case study on the workflows from an astronomy project known as the Palomar Transient Factory (PTF). This study processed 1.6 TB of system logs collected on the NERSC supercomputer Edison. Using PATHA, we were able to identify performance bottlenecks, which reside in three tasks of PTF workflow with the dependency on the density of celestial objects.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Slider Crank WEC Performance Analysis with Adaptive Autoregressive Filtering

This paper investigates a performance analysis of wave excitation force prediction to extract wave power for a slider crank power take-off system (PTOS) based on auto regressive (AR) filters. To efficiently convert wave energy into electricity, the prediction of wave excitation forces to keep the generator and the wave excitation force in sync is important for maximum energy extraction. The study shows a prediction methodology of half period and zero crossings in the practical scenario of irregular ocean waves. The prediction has been tested for different wave periods and with different filter orders. The prediction results have been used in the PTOS simulation to analyze the energy extraction. It has been shown that the prediction accuracy in the wave half period between the truth data and the predicted data drives the WEC energy extraction efficiency. The amplitude of the wave force is not used and hence the prediction deviation in the wave force amplitude does not affect the PTOS energy extraction. Further analysis shows that the optimum energy can be extracted at 15 th order filter with moderate prediction horizon length.

autoregressive filter↗

Procedure for Performing Security Camera Optical Performance Analysis Tests

Digital security camera technologies proliferate the security marketplace with manufacturers extoling the functions, features, specifications and virtues of their cameras. A process to comparatively analyze security camera technologies using international camera analysis standards and methods provides a defensible means to assess camera image quality on a technically comparable basis. The procedures in this document use ISO standard camera test charts and camera image analysis software to perform test chart image analysis for comparative camera assessment. Step-by-step procedures for acquiring test chart images in the laboratory and producing analysis data using analysis software GUI controls and interfaces for comparative analysis of security camera image quality are detailed in this document. The procedures have been validated through the test and analysis of fixed box and 180 degree field of view multi-imager cameras as well as, fixed and varifocal lenses and analog-to-digital video encoder image quality performance attributes.

42 ENGINEERING↗

Formulas for Fast Computation of Divergence Statistics Applied to Quantitative Performance Analysis

In an earlier work, we reported on the extension to the statistical analysis capability of the Visualization Tool Kit (VTK), which we developed for the calculation of divergence statistics, with the particular aim of providing quantitative means for High Performance Computing (HPC) performance analysis, of which we provided an example as well as user's manual. However, we did not provide the mathematical foundations for this work. In the current report, we fill this void with the complete derivation of the formulas which we used in the divergence statistics engine. This provides the foundations for future work which will aim at generalizing these formulas for more detailed HPC performance analysis.

97 MATHEMATICS AND COMPUTING↗