Search NASA⌕ Search

SEARCH · Search NASA

Results for “Threading”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

FOX: A Fault-Oblivious Extreme-Scale Execution Environment Boston University Final Report Project Number: DE-SC0005365

Exascale computing systems will provide a thousand-fold increase in parallelism and a proportional increase in failure rate relative to today's machines. Systems software for exascale machines must provide the infrastructure to support existing applications while simultaneously enabling efficient execution of new programming models that naturally express dynamic, adaptive, irregular computation; coupled simulations; and massive data analysis in a highly unreliable hardware environment with billions of threads of execution. The FOX project explored systems software and runtime support for a new approach to the data and work distribution for fault oblivious application execution. Our major OS work at Boston University focused on developing a new light-weight operating systems model that provides an appropriate context for both multi-core and multi-node application development. This work is discussed in section 1. Early on in the FOX project BU developed infrastructure for prototyping dynamic HPC environments in which the sets of nodes that an application is run on can be dynamically grown or shrunk. This work was an extension of the Kittyhawk project and is discussed in section 2. Section 3 documents the publications and software repositories that we have produced. To put our work in context of the complete FOX project contribution we include in section 4 an extended version of a paper that documents the complete work of the FOX team.

97 MATHEMATICS AND COMPUTING↗

HPC4Energy Final Report : GE Energy

Power System planning tools are being used today to simulate systems that are far larger and more complex than just a few years ago. Advances in renewable technologies and more pervasive control technology are driving planning engineers to analyze an increasing number of scenarios and system models with much more detailed network representations. Although the speed of individual CPU’s has increased roughly according to Moore’s Law, the requirements for advanced models, increased system sizes, and larger sensitivities have outstripped CPU performance. This computational dilemma has reached a critical point and the industry needs to develop the technology to accurately model the power system of the future. The hpc4energy incubator program provided a unique opportunity to leverage the HPC resources available to LLNL and the power systems domain expertise of GE Energy to enhance the GE Concorda PSLF software. Well over 500 users worldwide, including all of the major California electric utilities, rely on Concorda PSLF software for their power flow and dynamics. This pilot project demonstrated that the GE Concorda PSLF software can perform contingency analysis in a massively parallel environment to significantly reduce the time to results. An analysis with 4,127 contingencies that would take 24 days on a single core was reduced to 24 minutes when run on 4,217 cores. A secondary goal of this project was to develop and test modeling techniques that will expand the computational capability of PSLF to efficiently deal with systems sizes greater than 150,000 buses. Toward this goal the matrix reordering implementation time was sped up 9.5 times by optimizing the code and introducing threading.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

High Efficacy Green LEDs by Polarization Controlled MOVPE

Amazing performance in GaInN/GaN based LEDs has become possible by advanced epitaxial growth on a wide variety of substrates over the last decade. An immediate push towards product development and worldwide competition for market share have effectively reduced production cost and generated substantial primary energy savings on a worldwide scale. At all times of the development, this economic pressure forced very fundamental decisions that would shape huge industrial investment. One of those major aspects is the choice of epitaxial growth substrate. The natural questions are to what extend a decision for a certain substrate will limit the ultimate performance and to what extent, the choice of a currently more expensive substrate such as native GaN could overcome any of the remaining performance limitations. Therefore, this project has set out to explore what performance characteristic could be achieved under the utilization of bulk GaN substrate. Our work was guided by the hypotheses that line defects such as threading dislocations in the active region should be avoided and the huge piezoelectric polarization needs to be attenuated – if not turned off – for higher performing LEDs, particularly in the longer wavelength green and deep green portions of the visible spectrum. At their relatively lower performance level, deep green LEDs are a stronger indicator of relative performance improvements and seem particular sensitive to the challenges at hand.

36 MATERIALS SCIENCE↗

Lightweight and Statistical Techniques for Petascale PetaScale Debugging

This project investigated novel techniques for debugging scientific applications on petascale architectures. In particular, we developed lightweight tools that narrow the problem space when bugs are encountered. We also developed techniques that either limit the number of tasks and the code regions to which a developer must apply a traditional debugger or that apply statistical techniques to provide direct suggestions of the location and type of error. We extend previous work on the Stack Trace Analysis Tool (STAT), that has already demonstrated scalability to over one hundred thousand MPI tasks. We also extended statistical techniques developed to isolate programming errors in widely used sequential or threaded applications in the Cooperative Bug Isolation (CBI) project to large scale parallel applications. Overall, our research substantially improved productivity on petascale platforms through a tool set for debugging that complements existing commercial tools.

97 MATHEMATICS AND COMPUTING↗

Hopper Workload Analysis

The National Energy Research Scientific Computing (NERSC) Center is the primary computing facility for the United States Department of Energy, Office of Science. With over 5,000 users and over 600 different applications utilizing NERSC systems, it is critically important to examine the workload running on NERSCs large supercomputers in order to procure systems that perform well for a broad workload. In this paper we show the breakdown of the NERSC workload by science area, algorithm, memory, thread usage and more. We also describe the methods used to collect data from NERSCs Hopper (Cray XE6) system.

97 MATHEMATICS AND COMPUTING↗

FOX: A Fault Oblivious Extreme-Scale Execution Environment

The FOX project, funded under the ASCR X-stack I program, developed systems software and runtime libraries for a new approach to the data and work distribution for massively parallel, fault oblivious application execution. Our work was motivated by the premise that exascale computing systems will provide a thousand-fold increase in parallelism and a proportional increase in failure rate relative to today’s machines. To deliver the capability of exascale hardware, the systems software must provide the infrastructure to support existing applications while simultaneously enabling efficient execution of new programming models that naturally express dynamic, adaptive, irregular computation; coupled simulations; and massive data analysis in a highly unreliable hardware environment with billions of threads of execution. Our OS research has prototyped new methods to provide efficient resource sharing, synchronization, and protection in a many-core compute node. We have experimented with alternative task/dataflow programming models and shown scalability in some cases to hundreds of thousands of cores. Much of our software is in active development through open source projects. Concepts from FOX are being pursued in next generation exascale operating systems. Our OS work focused on adaptive, application tailored OS services optimized for multi → many core processors. We developed a new operating system NIX that supports role-based allocation of cores to processes which was released to open source. We contributed to the IBM FusedOS project, which promoted the concept of latency-optimized and throughput-optimized cores. We built a task queue library based on distributed, fault tolerant key-value store and identified scaling issues. A second fault tolerant task parallel library was developed, based on the Linda tuple space model, that used low level interconnect primitives for optimized communication. We designed fault tolerance mechanisms for task parallel computations employing work stealing for load balancing that scaled to the largest existing supercomputers. Finally, we implemented the Elastic Building Blocks runtime, a library to manage object-oriented distributed software components. To support the research, we won two INCITE awards for time on Intrepid (BG/P) and Mira (BG/Q). Much of our work has had impact in the OS and runtime community through the ASCR Exascale OS/R workshop and report, leading to the research agenda of the Exascale OS/R program. Our project was, however, also affected by attrition of multiple PIs. While the PIs continued to participate and offer guidance as time permitted, losing these key individuals was unfortunate both for the project and for the DOE HPC community.

97 MATHEMATICS AND COMPUTING↗

LAMMPS strong scaling performance optimization on Blue Gene/Q

LAMMPS "Large-scale Atomic/Molecular Massively Parallel Simulator" is an open-source molecular dynamics package from Sandia National Laboratories. Significant performance improvements in strong-scaling and time-to-solution for this application on IBM's Blue Gene/Q have been achieved through computational optimizations of the OpenMP versions of the short-range Lennard-Jones term of the CHARMM force field and the long-range Coulombic interaction implemented with the PPPM (particle-particle-particle mesh) algorithm, enhanced by runtime parameter settings controlling thread utilization. Additionally, MPI communication performance improvements were made to the PPPM calculation by re-engineering the parallel 3D FFT to use MPICH collectives instead of point-to-point. Performance testing was done using an 8.4-million atom simulation scaling up to 16 racks on the Mira system at Argonne Leadership Computing Facility (ALCF). Speedups resulting from this effort were in some cases over 2x.

Coffman, Paul↗

Final Report for Grant DOE DE-FG02-08ER64573 (Relating to Turbulence Modeling)

Turbulence enhances transport and mixing. Turbulent ocean currents can increase the encounter rate between fish larvae and their prey. Without turbulence, the fuel and air injected into the cylinder of an internal combustion engine would mix too slowly to be effective. Birds extract energy from turbulent winds to soar for great distances without flapping their wings. Turbulence can be detrimental as well. The efficiencies of vehicles, pipelines, and industrial equipment are all hindered by turbulence. Turbulence can also cause structural fatigue, generate unwanted noise, and distort the propagation of electromagnetic signals. These observations highlight the importance of turbulence research. Our ability to predict and control turbulence and, thus, to intensify or suppress its effects as circumstances warrant is contingent on our understanding of the underlying mechanisms. Turbulence is also immensely interesting from a purely scientific perspective and is a great source of fundamentally important, challenging problems for physicists, engineers, and mathematicians. Moreover, various methods and tools developed in the field have found applications in other fields, including nonlinear optics, nonlinear acoustics, pattern formation, image processing, data compression, and econophysics. It is possible, at least away from walls, to derive LES models of very high-order accuracy. However, these models also lead to correspondingly intense computational complexity for their numerical solution. Some also introduce yet more questions on the already difficult problem of specifying needed and sometimes artificial local boundary conditions for the inherently nonlocal flow averages. For these two (and other) reasons, there has been a resurgence of interest in basing simulations of turbulent flows on much simpler regularizations of the Navier–Stokes equations rather than on full models of local averages--i.e., LES models. Initially these were developed as pure theoretical tools. The influx of ideas from LES and the added constraint that the regularization be amenable to numerical simulation have breathed new perspective and thus new life into this thread of ideas.Over the past year, a significant portion of our research activity has focused on numerical studies of the Navier–Stokes-$αβ$ model and extensions thereof. Our results regarding these and other approaches to turbulence modeling are described below.

97 MATHEMATICS AND COMPUTING↗

A Block-Asynchronous Relaxation Method for Graphics Processing Units

In this paper, we analyze the potential of asynchronous relaxation methods on Graphics Processing Units (GPUs). For this purpose, we developed a set of asynchronous iteration algorithms in CUDA and compared them with a parallel implementation of synchronous relaxation methods on CPU-based systems. For a set of test matrices taken from the University of Florida Matrix Collection we monitor the convergence behavior, the average iteration time and the total time-to-solution time. Analyzing the results, we observe that even for our most basic asynchronous relaxation scheme, despite its lower convergence rate compared to the Gauss-Seidel relaxation (that we expected), the asynchronous iteration running on GPUs is still able to provide solution approximations of certain accuracy in considerably shorter time then Gauss- Seidel running on CPUs. Hence, it overcompensates for the slower convergence by exploiting the scalability and the good fit of the asynchronous schemes for the highly parallel GPU architectures. Further, enhancing the most basic asynchronous approach with hybrid schemes – using multiple iterations within the ”subdomain” handled by a GPU thread block and Jacobi-like asynchronous updates across the ”boundaries”, subject to tuning various parameters – we manage to not only recover the loss of global convergence but often accelerate convergence of up to two times (compared to the effective but difficult to parallelize Gauss-Seidel type of schemes), while keeping the execution time of a global iteration practically the same. This shows the high potential of the asynchronous methods not only as a stand alone numerical solver for linear systems of equations fulfilling certain convergence conditions but more importantly as a smoother in multigrid methods. Due to the explosion of parallelism in todays architecture designs, the significance and the need for asynchronous methods, as the ones described in this work, is expected to grow.

97 MATHEMATICS AND COMPUTING↗

Calibration and Forward Uncertainty Propagation for Large-eddy Simulations of Engineering Flows

The objective of this work is to investigate the efficacy of using calibration strategies from Uncertainty Quantification (UQ) to determine model coefficients for LES. As the target methods are for engineering LES, uncertainty from numerical aspects of the model must also be quantified. 15 The ultimate goal of this research thread is to generate a cost versus accuracy curve for LES such that the cost could be minimized given an accuracy prescribed by an engineering need. Realization of this goal would enable LES to serve as a predictive simulation tool within the engineering design process.

42 ENGINEERING↗

A Reduced Order Model of Force Displacement Curves for the Failure of Mechanical Bolts in Tension.

Assembled mechanical systems often contain a large number of bolted connections. These bolted connections (joints) are integral aspects of the load path for structural dynamics, and, consequently, are paramount for calculating a structure's stiffness and energy dissipation prop- erties. However, analysts have not found the optimal method to model appropriately these bolted joints. The complexity of the screw geometry causes issues when generating a mesh of the model. This report will explore different approaches to model a screw-substrate connec- tion. Model parameters such as mesh continuity, node alignment, wedge angles, and thread to body element size ratios are examined. The results of this study will give analysts a better understanding of the influences of these parameters and will aide in finding the optimal method to model bolted connections.

42 ENGINEERING↗

Rendering and Compositing Infrastructure Improvements to VisIt for Insitu Rendering

Compared to posthoc rendering, insitu rendering often generates larger numbers of images, as a result rendering performance and scalability are critical in the insitu setting. In this work we present improvements to VisIt's rendering and compositing infrastructure that deliver increased performance and scalability in both posthoc and insitu settings. We added the capability for alpha blend compositing and use it with ordered compositing when datasets have disjoint block domain decomposition to optimize the rendering of transparent geometry. We also made improvements that increase overall efficiency by reducing communication and data movement and have addressed a number of performance issues. We structured our code to take advantage of SIMD parallelization and use threads to overlap communication and compositing. We tested our improvements on a 20 core workstation using 8 cores to render geometry generated from a $256^3$ cosmology dataset and on a Cray XC31 using 512 cores to render geometry generated from a $2000^2 \times 800$ plasma dataset. Our results show that ordered compositing provides a speed up of up to $4 \times$ over the current sort first strategy. The other improvements resulted in modest speed up with one notable exception where we achieve up to $40 \times$ speed up of rendering and compositing of opaque geometry when both opaque and transparent geometry are rendered together. We also investigated the use of depth peeling, but found that the implementation provided by VTK is substantially slower,both with and without GPU acceleration, than a local camera order sort.

97 MATHEMATICS AND COMPUTING↗

Task Order 22 – Engineering and Technical Support, Deep Borehole Field Test. AREVA Summary Review Report

Under Task Order 22 of the industry Advisory and Assistance Services (A&AS) Contract to the Department of Energy (DOE) DE-NE0000291, AREVA has been tasked with providing assistance with engineering, analysis, cost estimating, and design support of a system for disposal of radioactive wastes in deep boreholes (without the use of radioactive waste). As part of this task order, AREVA was requested, through a letter of technical direction, to evaluate Sandia National Laboratory’s (SNL’s) waste package borehole emplacement system concept recommendation using input from DOE and SNL. This summary review report (SRR) documents this evaluation, with its focus on the primary input document titled: “Deep Borehole Field Test Specifications/M2FT-15SN0817091” Rev. 1 [1], hereafter referred to as the “M2 report.” The M2 report focuses on the conceptual design development for the Deep Borehole Field Test (DBFT), mainly the test waste packages (WPs) and the system for demonstrating emplacement and retrieval of those packages in the Field Test Borehole (FTB). This SRR follows the same outline as the M2 report, which allows for easy correlation between AREVA’s review comments, discussion, potential proposed alternatives, and path forward with information established in the M2 report. AREVA’s assessment focused on three primary elements of the M2 report: the conceptual design of the WPs proposed for deep borehole disposal (DBD), the mode of emplacement of the WP into DBD, and the conceptual design of the DBFT. AREVA concurs with the M2 report’s selection of the wireline emplacement mode specifically over the drill-string emplacement mode and generically over alternative emplacement modes. Table 5-1 of this SRR compares the pros and cons of each emplacement mode considered viable for DBD. The primary positive characteristics of the wireline emplacement mode include: (1) considered a mature technology; (2) operations are relatively simple; (3) probability of a radiological release due to off-normal events are relatively low; (4) costs are relatively low; and (5) maintenance activities are relatively simple. The primary drawback associated with the wireline emplacement mode for DBD is the number of emplacement trips-in to the borehole, which results in a relatively higher probability for a drop event. Fortunately, the WPs can be engineered with impact limiters that will minimize the likelihood of a breach of the WP due to a drop. The WP designs presented in the M2 report appear to be focused on compatibility with the drill-string emplacement mode (e.g., the threaded connections). With the recommendation that the wireline emplacement mode be utilized for the DBFT, some changes may be warranted to these WPs. For example, the development of a WP release connection that is more reliable than the currently credited connection, which is considered to have a high failure probability, and the integration of an impact limiter into its design. The M2 report states the engineering demonstration of the DBFT will occur in the FTB over a 4-year period. AREVA recommends development and testing of the WP emplacement handling equipment occur separately (but concurrently, if not earlier) from the FTB at a mock-up facility. The separation of this activity would prevent schedule interference between the science and engineering thrusts of the project. Performing tests in a mock-up facility would allow additional control and observation compared to the FTB. The mock-up facility could also be utilized as a training facility for future operations. Terminal velocity and impact limiter testing would require the FTB for testing, since these areas would be difficult to reproduce in a limited depth mock-up. Although only at the end of the conceptual stage of design development, DBD appears to be a viable solution for some waste forms produced by the nuclear industry. However, regulatory requirements have yet to be established for pre- and post-closure performance of DBD and should be established as soon as possible. Some of the main areas of focus from a regulatory perspective include: (1) establishing acceptable performance requirements for the long-term behavior of DBD; (2) determining acceptable borehole abandonment criteria; (3) establishing retrievability requirements; (4) developing a consensus on the factor of safety (FoS) for the emplacement mode and WP; and (5) establishing safety and safeguards performance requirements for DBD. Although conservative requirements have been utilized to provide the foundation for the conceptual design of DBD, regulatory requirements and feedback are necessary to confirm recommendations made herein and to ensure the long-term performance of DBD is acceptable. The combination of the M2 report and this SRR is intended to facilitate the completion of the conceptual design for DBD for the Cs and Sr capsules and calcined waste forms. Using the conceptual design, preliminary design activities (the second stage of a three-stage process described in the M2 report) can proceed and the DBFT utilized to support, demonstrate, and confirm engineering elements of this design.

42 ENGINEERING↗

Planning for Pre-Exascale Platform Environment (Fiscal Year 2015 Level 2 Milestone 5216)

This Plan for ASC Pre-Exascale Platform Environments document constitutes the deliverable for the fiscal year 2015 (FY15) Advanced Simulation and Computing (ASC) Program Level 2 milestone Planning for Pre-Exascale Platform Environment. It acknowledges and quantifies challenges and recognized gaps for moving the ASC Program towards effective use of exascale platforms and recommends strategies to address these gaps. This document also presents an update to the concerns, strategies, and plans presented in the FY08 predecessor document that dealt with the upcoming (at the time) petascale high performance computing (HPC) platforms. With the looming push towards exascale systems, a review of the earlier document was appropriate in light of the myriad architectural choices currently under consideration. The ASC Program believes the platforms to be fielded in the 2020s will be fundamentally different systems that stress ASC’s ability to modify codes to take full advantage of new or unique features. In addition, the scale of components will increase the difficulty of maintaining an errorfree system, thus driving new approaches to resilience and error detection/correction. The code revamps of the past, from serial- to vector-centric code to distributed memory to threaded implementations, will be revisited as codes adapt to a new message passing interface (MPI) plus “x” or more advanced and dynamic programming models based on architectural specifics. Development efforts are already underway in some cases, and more difficult or uncertain aspects of the new architectures will require research and analysis that may inform future directions for program choices. In addition, the potential diversity of system architectures may require parallel if not duplicative efforts to analyze and modify environments, codes, subsystems, libraries, debugging tools, and performance analysis techniques as well as exploring new monitoring methodologies. It is difficult if not impossible to selectively eliminate some of these activities until more information is available through simulations of potential architectures, analysis of systems designs, and informed study of commodity technologies that will be the constituent parts of future platforms.

97 MATHEMATICS AND COMPUTING↗

DIORAMA Communications

Diorama is written as a collection of modules that can run in separate threads or in separate processes. This defines a clear interface between the modules and also allows concurrent processing of different parts of the pipeline. The pipeline is determined by a description in a scenario file[Norman and Tornga, 2012, Tornga and Norman, 2014]. The scenario manager parses the XML scenario and sets up the sequence of modules which will generate an event, propagate the signal to a set of sensors, and then run processing modules on the results provided by those sensor simulations. During a run a variety of “observer” and “processor” modules can be invoked to do interim analysis of results. Observers do not modify the simulation results, while processors may affect the final result. At the end of a run results are collated and final reports are put out. A detailed description of the scenario file and how it puts together a simulation are given in [Tornga and Norman, 2014]. The processing pipeline and how to program it with the Diorama API is described in Tornga et al. [2015] and Tornga and Wakeford [2015]. In this report I describe the communications infrastructure that is used.

97 MATHEMATICS AND COMPUTING↗

Programming Models in HPC

These are the slides for a presentation on programming models in HPC, at the Los Alamos National Laboratory's Parallel Computing Summer School. The following topics are covered: Flynn's Taxonomy of computer architectures; single instruction single data; single instruction multiple data; multiple instruction multiple data; address space organization; definition of Trinity (Intel Xeon-Phi is a MIMD architecture); single program multiple data; multiple program multiple data; ExMatEx workflow overview; definition of a programming model, programming languages, runtime systems; programming model and environments; MPI (Message Passing Interface); OpenMP; Kokkos (Performance Portable Thread-Parallel Programming Model); Kokkos abstractions, patterns, policies, and spaces; RAJA, a systematic approach to node-level portability and tuning; overview of the Legion Programming Model; mapping tasks and data to hardware resources; interoperability: supporting task-level models; Legion S3D execution and performance details; workflow, integration of external resources into the programming model.

97 MATHEMATICS AND COMPUTING↗

A Fault-oblivious Extreme-scale Execution Environment

Exascale computing systems will provide a thousand-fold increase in parallelism and a proportional increase in failure rate relative to today's machines. Systems software for exascale machines must provide the infrastructure to support existing applications while simultaneously enabling efficient execution of new programming models that naturally express dynamic, adaptive, irregular computation; coupled simulations; and massive data analysis in a highly unreliable hardware environment with billions of threads of execution. We propose a new approach to the data and work distribution model provided by system software based on the unifying formalism of an abstract file system. The proposed hierarchical data model provides simple, familiar visibility and access to data structures through the file system hierarchy, while providing fault tolerance through selective redundancy. The hierarchical task model features work queues whose form and organization are represented as file system objects. Data and work are both first class entities. By exposing the relationships between data and work to the runtime system, information is available to optimize execution time and provide fault tolerance. The data distribution scheme provides replication (where desirable and possible) for fault tolerance and efficiency, and it is hierarchical to make it possible to take advantage of locality. The user, tools, and applications, including legacy applications, can interface with the data, work queues, and one another through the abstract file model. This runtime environment will provide multiple interfaces to support traditional Message Passing Interface applications, languages developed under DARPA's High Productivity Computing Systems program, as well as other, experimental programming models. We will validate our runtime system with pilot codes on existing platforms and will use simulation to validate for exascale-class platforms. In this final report, we summarize research results from the work done at the Ohio State University towards the larger goals of the project listed above.

97 MATHEMATICS AND COMPUTING↗

OpenMPI and ExxonMobil Topics

These are a series of slides for a presentation for ExxonMobil's visit to Los Alamos National Laboratory. Topics covered are: Open MPI - The Release Story, MPI-3 RMA in Open MPI, MPI dynamic process management and Open MPI, and new options with CLE 6. Open MPI RMA features are: since v2.0.0 full support for the MPI-3.1 specification, support for non-contiguous datatypes, support for direct use of the RDMA capabilities of high performance networks (Cray Gemini/Aries, Infiniband), starting in v2.1.0 will have support for using network atomic operations for MPI_Fetch_and_op and MPI_Compare_and_swap, tested with MPI_THREAD_MULTIPLE.

97 MATHEMATICS AND COMPUTING↗