Search NASA⌕ Search

SEARCH · Search NASA

Results for “Hybrid programs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Strategies for Energy-Efficient Resource Management of Hybrid Programming Models

Many scientific applications are programmed using hybrid programming models that use both message passing and shared memory, due to the increasing prevalence of large-scale systems with multicore, multisocket nodes. Previous work has shown that energy efficiency can be improved using software-controlled execution schemes that consider both the programming model and the power-aware execution capabilities of the system. However, such approaches have focused on identifying optimal resource utilization for one programming model, either shared memory or message passing, in isolation. The potential solution space, thus the challenge, increases substantially when optimizing hybrid models since the possible resource configurations increase exponentially. Nonetheless, with the accelerating adoption of hybrid programming models, we increasingly need improved energy efficiency in hybrid parallel applications on large-scale systems. In this work, we present new software-controlled execution schemes that consider the effects of dynamic concurrency throttling (DCT) and dynamic voltage and frequency scaling (DVFS) in the context of hybrid programming models. Specifically, we present predictive models and novel algorithms based on statistical analysis that anticipate application power and time requirements under different concurrency and frequency configurations. Furthermore, we apply our models and methods to the NPB MZ benchmarks and selected applications from the ASC Sequoia codes. Overall, we achieve substantial energy savings (8.74 percent on average and up to 13.8 percent) with some performance gain (up to 7.5 percent) or negligible performance loss.

97 MATHEMATICS AND COMPUTING↗

Hybrid Programming for Near-Term Quantum Computing Systems

Recent computations involving quantum processing units (QPUs) have demonstrated a series of challenges inherent to hybrid classical-quantum programming, compilation, execution, and verification and validation. Despite considerable progress, system-level noise, limited low-level instructions sets, remote access models, and an overall lack of portability and classical integration presents near-term programming challenges that must be overcome in order to enable reliable scientific quantum computing and support robust hardware benchmarking. In this work, we draw on our experience in programming QPUs to identify common concerns and challenges, and detail best practices for mitigating these challenges within the current hybrid classical-quantum computing paradigm. Following this discussion, we introduce the XACC quantum compilation and execution framework as a hardware and language independent solution that addresses many of these hybrid programming challenges. XACC supports extensible methodologies for managing a variety of programming, compilation, and execution concerns across the increasingly diverse set of QPUs. We use recent nuclear physics simulations to illustrate how the framework mitigates programming, compilation, and execution challenges and manages the complex workflow present in QPU-enhanced scientific applications. Finally, we codify the resulting hybrid scientific computing workflow in order to identify key areas requiring future improvement.

Mccaskey, Alex↗

A hybrid programming model for compressible gas dynamics using openCL

The current trend towards multicore/manycore and accelerated architectures presents challenges, both in portability, and also in the choices that developers must make on how to use the resources that these architectures provide. This paper explores some of the possibilities that are enabled by the Open Computing Language (OpenCL), and proposes a programming model that allows developers and scientists to more fully subscribe hybrid compute nodes, while, at the same time, reducing the impact of system failure.

97 MATHEMATICS AND COMPUTING↗

QuaSiMo: A composable library to program hybrid workflows for quantum simulation

Abstract A composable design scheme is presented for the development of hybrid quantum/classical algorithms and workflows for applications of quantum simulation. The proposed object‐oriented approach is based on constructing an expressive set of common data structures and methods that enables programming of a broad variety of complex hybrid quantum simulation applications. The abstract core of the scheme is distilled from the analysis of the current quantum simulation algorithms. Subsequently, it allows synthesis of new hybrid algorithms and workflows via the extension, specialisation, and dynamic customisation of the abstract core classes defined by the proposed design. The design scheme is implemented using the hardware‐agnostic programming language QCOR into the QuaSiMo library. To validate the implementation, the authors test and show its utility on commercial quantum processors from IBM and Rigetti, running some prototypical quantum simulations.

97 MATHEMATICS AND COMPUTING↗

Composable Programming of Hybrid Workflows for Quantum Simulation

We present a composable design scheme for the development of hybrid quantum/classical algorithms and workflows for applications of quantum simulation. Our object-oriented approach is based on constructing an expressive set of common data structures and methods that enable programming of a broad variety of complex hybrid quantum simulation applications. The abstract core of our scheme is distilled from the analysis of the current quantum simulation algorithms. Subsequently, it allows a synthesis of new hybrid algorithms and workflows via the extension, specialization, and dynamic customization of the abstract core classes defined by our design. We implement our design scheme using the hardware-agnostic programming language QCOR into the QuaSiMo library. To validate our implementation, we test and show its utility on commercial quantum processors from IBM, running some prototypical quantum simulations.

97 MATHEMATICS AND COMPUTING↗

XACC - eXtreme-scale Accelerator Programming Framework

Hybrid programming models for beyond-CMOS technologies will prove critical for integrating new computing technologies alongside our existing infrastructure. Unfortunately the software infrastructure required to enable this is lacking or not available. XACC is a programming framework for extreme-scale, post-exascale accelerator architectures that integrates alongside existing conventional applications. It is a pluggable framework for programming languages developed for next-gen computing hardware architectures like quantum and neuromorphic computing. It lets computational scientists efficiently off-load classically intractable work to attached accelerators through user-friendly Kernel definitions. XACC makes post-exascale hybrid programming approachable for domain computational scientists.

McCaskey, AlexanderJ.↗

XACC - eXtreme-scale Accelerator Programming Framework

Hybrid programming models for beyond-CMOS technologies will prove critical for integrating new computing technologies alongside our existing infrastructure. Unfortunately the software infrastructure required to enable this is lacking or not available. XACC is a programming framework for extreme-scale, post-exascale accelerator architectures that integrates alongside existing conventional applications. It is a pluggable framework for programming languages developed for next-gen computing hardware architectures like quantum and neuromorphic computing. It lets computational scientists efficiently off-load classically intractable work to attached accelerators through user-friendly Kernel definitions. XACC makes post-exascale hybrid programming approachable for domain computational scientists.

McCaskey, Alexander J.↗

Hybrid parallel programming with MPI and Unified Parallel C.

The Message Passing Interface (MPI) is one of the most widely used programming models for parallel computing. However, the amount of memory available to an MPI process is limited by the amount of local memory within a compute node. Partitioned Global Address Space (PGAS) models such as Unified Parallel C (UPC) are growing in popularity because of their ability to provide a shared global address space that spans the memories of multiple compute nodes. However, taking advantage of UPC can require a large recoding effort for existing parallel applications. In this paper, we explore a new hybrid parallel programming model that combines MPI and UPC. This model allows MPI programmers incremental access to a greater amount of memory, enabling memory-constrained MPI codes to process larger data sets. In addition, the hybrid model offers UPC programmers an opportunity to create static UPC groups that are connected over MPI. As we demonstrate, the use of such groups can significantly improve the scalability of locality-constrained UPC codes. This paper presents a detailed description of the hybrid model and demonstrates its effectiveness in two applications: a random access benchmark and the Barnes-Hut cosmological simulation. Experimental results indicate that the hybrid model can greatly enhance performance; using hybrid UPC groups that span two cluster nodes, RA performance increases by a factor of 1.33 and using groups that span four cluster nodes, Barnes-Hut experiences a twofold speedup at the expense of a 2% increase in code size.

99 GENERAL AND MISCELLANEOUS↗

WE-G-204-00: Post-Graduate Training of the Next Generation of Academic Medical Physicists

While many indicators for academic medical physics are distressing – jobs are tight, demands on clinical time are high (and getting worse) and national funding has been flat for several years (meaning less money in reality) the present is perhaps one of the most exciting times in cancer research history, and medical physicists have an opportunity to make a difference. Many of us predict the impact of medical physics on cancer research over the next decade to be more significant than ever. Why is that? First, medical imaging is used for every cancer patient in developed countries. Every improvement in the acquisition, processing or analysis of radiological images has the potential to impact patients. The use of radiation therapy is at an all-time high – and virtually cannot be performed without medical physics. Many of the advances in both biomedical imaging and radiation oncology are the result of the hard work of academic medical physicists who are thinking of the next generation of technologies that will be used against cancer or an even broader spectrum of diseases. A career in academic medical physics is demanding, particularly for those with clinical responsibilities. As the demands for justification of their clinical effort become increasingly metricized, the ability to do “unfunded research” will become even more difficult. This means that many will have to generate external salary support to justify their efforts in research and development. This comes at a time when funding for research is compressed and harder to obtain. Generally speaking, if you are not contributing 50% or more of your effort to research, you are competing at a disadvantage and it is very unlikely you will get an NIH/NCI/NIBIB grant. Furthermore, in the ongoing effort to improve patient care and safety, we have developed credentialing pathways that now require at least two-years of residency training. This full-time clinical training creates a gap in the research trajectory of graduate students who aspire to academic positions with an expectation for extramural funding. To address this, several residency programs have created hybrid programs where the two-years of clinical training is combined with one or two years of research effort to allow candidates to further establish an academic identity and to ensure adequate academic productivity to compete for a beginning faculty position. In conclusion, while the path to a successful career in academic medical physics is steep and sometimes hard to follow, reaching the apex is worth the journey. Different paths to a career in medical physics are available, you just have to decide which one is right for you. If improving cancer care is your goal as a physicist, then academic medical physics is the job for you!.

60 APPLIED LIFE SCIENCES↗

WE-G-204-01: Building a Career in Academic Medical Physics: The Hardest and Best Job You Will Ever Have!

While many indicators for academic medical physics are distressing – jobs are tight, demands on clinical time are high (and getting worse) and national funding has been flat for several years (meaning less money in reality) the present is perhaps one of the most exciting times in cancer research history, and medical physicists have an opportunity to make a difference. Many of us predict the impact of medical physics on cancer research over the next decade to be more significant than ever. Why is that? First, medical imaging is used for every cancer patient in developed countries. Every improvement in the acquisition, processing or analysis of radiological images has the potential to impact patients. The use of radiation therapy is at an all-time high – and virtually cannot be performed without medical physics. Many of the advances in both biomedical imaging and radiation oncology are the result of the hard work of academic medical physicists who are thinking of the next generation of technologies that will be used against cancer or an even broader spectrum of diseases. A career in academic medical physics is demanding, particularly for those with clinical responsibilities. As the demands for justification of their clinical effort become increasingly metricized, the ability to do “unfunded research” will become even more difficult. This means that many will have to generate external salary support to justify their efforts in research and development. This comes at a time when funding for research is compressed and harder to obtain. Generally speaking, if you are not contributing 50% or more of your effort to research, you are competing at a disadvantage and it is very unlikely you will get an NIH/NCI/NIBIB grant. Furthermore, in the ongoing effort to improve patient care and safety, we have developed credentialing pathways that now require at least two-years of residency training. This full-time clinical training creates a gap in the research trajectory of graduate students who aspire to academic positions with an expectation for extramural funding. To address this, several residency programs have created hybrid programs where the two-years of clinical training is combined with one or two years of research effort to allow candidates to further establish an academic identity and to ensure adequate academic productivity to compete for a beginning faculty position. In conclusion, while the path to a successful career in academic medical physics is steep and sometimes hard to follow, reaching the apex is worth the journey. Different paths to a career in medical physics are available, you just have to decide which one is right for you. If improving cancer care is your goal as a physicist, then academic medical physics is the job for you!.

60 APPLIED LIFE SCIENCES↗

WE-G-204-02: So You Want to Do Research: Two Approaches to Beginning a Career in Medical Physics Research

While many indicators for academic medical physics are distressing – jobs are tight, demands on clinical time are high (and getting worse) and national funding has been flat for several years (meaning less money in reality) the present is perhaps one of the most exciting times in cancer research history, and medical physicists have an opportunity to make a difference. Many of us predict the impact of medical physics on cancer research over the next decade to be more significant than ever. Why is that? First, medical imaging is used for every cancer patient in developed countries. Every improvement in the acquisition, processing or analysis of radiological images has the potential to impact patients. The use of radiation therapy is at an all-time high – and virtually cannot be performed without medical physics. Many of the advances in both biomedical imaging and radiation oncology are the result of the hard work of academic medical physicists who are thinking of the next generation of technologies that will be used against cancer or an even broader spectrum of diseases. A career in academic medical physics is demanding, particularly for those with clinical responsibilities. As the demands for justification of their clinical effort become increasingly metricized, the ability to do “unfunded research” will become even more difficult. This means that many will have to generate external salary support to justify their efforts in research and development. This comes at a time when funding for research is compressed and harder to obtain. Generally speaking, if you are not contributing 50% or more of your effort to research, you are competing at a disadvantage and it is very unlikely you will get an NIH/NCI/NIBIB grant. Furthermore, in the ongoing effort to improve patient care and safety, we have developed credentialing pathways that now require at least two-years of residency training. This full-time clinical training creates a gap in the research trajectory of graduate students who aspire to academic positions with an expectation for extramural funding. To address this, several residency programs have created hybrid programs where the two-years of clinical training is combined with one or two years of research effort to allow candidates to further establish an academic identity and to ensure adequate academic productivity to compete for a beginning faculty position. In conclusion, while the path to a successful career in academic medical physics is steep and sometimes hard to follow, reaching the apex is worth the journey. Different paths to a career in medical physics are available, you just have to decide which one is right for you. If improving cancer care is your goal as a physicist, then academic medical physics is the job for you!.

60 APPLIED LIFE SCIENCES↗

Designing and prototyping extensions to the Message Passing Interface in MPICH

As HPC system architectures and the applications running on them continue to evolve, the MPI standard itself must evolve. The trend in current and future HPC systems toward powerful nodes with multiple CPU cores and multiple GPU accelerators makes efficient support for hybrid programming critical for applications to achieve high performance. However, the support for hybrid programming in the MPI standard has not kept up with recent trends. The MPICH implementation of MPI provides a platform for implementing and experimenting with new proposals and extensions to fill this gap and to gain valuable experience and feedback before the MPI Forum can consider them for standardization. Here, in this work, we detail six extensions implemented in MPICH to increase MPI interoperability with other runtimes, with a specific focus on heterogeneous architectures. First, the extension to MPI generalized requests lets applications integrate asynchronous tasks into MPI’s progress engine. Second, the iovec extension to datatypes lets applications use MPI datatypes as a general-purpose data layout API beyond just MPI communications. Third, a new MPI object, MPIX_Stream, can be used by applications to identify execution contexts beyond MPI processes, including threads and GPU streams. MPIX stream communicators can be created to make existing MPI functions thread-aware and GPU-aware, thus providing applications with explicit ways to achieve higher performance. Fourth, MPIX Streams are extended to support the enqueue semantics for offloading MPI communications onto a GPU stream context. Fifth, thread communicators allow MPI communicators to be constructed with individual threads, thus providing a new level of interoperability between MPI and on-node runtimes such as OpenMP. Lastly, we present an extension to invoke MPI progress, which lets users spawn progress threads with fine-grained control to adapt the communication performance to their application designs. We describe the design and implementation of these extensions, provide usage examples, and highlight their expected benefits with performance results.

97 MATHEMATICS AND COMPUTING↗

Hybrid-view programming of nuclear fusion simulation code in the PGAS parallel programming language XcalableMP

Recently, the Partitioned Global Address Space (PGAS) parallel programming model has emerged as a usable distributed memory programming model. XcalableMP (XMP) is a PGAS parallel programming language that extends base languages such as C and Fortran with directives in OpenMP-like style. XMP supports a global-view model that allows programmers to define global data and to map them to a set of processors, which execute the distributed global data as a single thread. In XMP, the concept of a coarray is also employed for local-view programming. In this study, we port Gyrokinetic Toroidal Code - Princeton (GTC-P), which is a three-dimensional gyrokinetic PIC code developed at Princeton University to study the microturbulence phenomenon in magnetically confined fusion plasmas, to XMP as an example of hybrid memory model coding with the global-view and local-view programming models. In local-view programming, the coarray notation is simple and intuitive compared with Message Passing Interface (MPI) programming while the performance is comparable to that of the MPI version. Thus, because the global-view programming model is suitable for expressing the data parallelism for a field of grid space data, we implement a hybrid-view version using a global-view programming model to compute the field and a local-view programming model to compute the movement of particles. Finally, the performance is degraded by 20% compared with the original MPI version, but the hybrid-view version facilitates more natural data expression for static grid space data (in the global-view model) and dynamic particle data (in the local-view model), and it also increases the readability of the code for higher productivity.

97 MATHEMATICS AND COMPUTING↗

Reaching bandwidth saturation using transparent injection parallelization

Although logically available, applications may not exploit enough instantaneous communication concurrency to maximize network utilization on HPC systems. This is exacerbated in hybrid programming models that combine single program multiple data with OpenMP or CUDA. We present the design of a “multi-threaded” runtime able to transparently increase the instantaneous network concurrency and to provide near saturation bandwidth, independent of the application configuration and dynamic behavior. The runtime offloads communication requests from application level tasks to multiple communication servers. The servers use system specific performance models to attain network saturation. Our techniques alleviate the need for spatial and temporal application level message concurrency optimizations. Experimental results show improved message throughput and bandwidth by as much as 150% for 4 KB messages on InfiniBand and by as much as 120% for 4 KB messages on Cray Aries. For more complex operations such as all-to-all collectives, we observe as much as 30% speedup. This translates into 23% speedup on 12,288 cores for a NAS FT implemented using FFTW. We observe as much as 76% speedup on 1500 cores for an already optimized UPC+OpenMP geometric multigrid application using hybrid parallelism. For the geometric multigrid GPU implementation, we observe as much as 44% speedup on 512 GPUs.

Chaimov, Nicholas↗

Hybrid programming-model strategies for GPU offloading of electronic structure calculation kernels

To address the challenge of performance portability and facilitate the implementation of electronic structure solvers, we developed the basic matrix library (BML) and Parallel, Rapid O(N), and Graph-based Recursive Electronic Structure Solver (PROGRESS) library. The BML implements linear algebra operations necessary for electronic structure kernels using a unified user interface for various matrix formats (dense and sparse) and architectures (CPUs and GPUs). Focusing on density functional theory and tight-binding models, PROGRESS implements several solvers for computing the single-particle density matrix and relies on BML. In this paper, we describe the general strategies used for these implementations on various computer architectures, using OpenMP target functionalities on GPUs, in conjunction with third-party libraries to handle performance critical numerical kernels. In this study, we demonstrate the portability of this approach and its performance in benchmark problems.

36 MATERIALS SCIENCE↗