Hybrid MPI+UPC

From HPCRL Wiki
(Difference between revisions)
Jump to: navigation, search
Line 1: Line 1:
 +
The Hybrid MPI+UPC programming model is a new approach to writing parallel programs that combines MPI and UPC in the same program.  This model has several important benefits.  It provides MPI programs with access to a large distributed shared global address space with significant advantages when compared with MPI-2 one-sided communication.  It provides UPC programmers with an additional level of locality control that can be used to create multiple UPC spaces connected via MPI.  Finally, it can provide access to libraries written in either model, e.g. access to PETSc and ScaLAPACK for UPC programmers.
 +
 
This page is intended to serve as early documentation on hybrid parallel programming using MPI and Unified Parallel C.
 
This page is intended to serve as early documentation on hybrid parallel programming using MPI and Unified Parallel C.
  

Revision as of 20:58, 5 May 2010

The Hybrid MPI+UPC programming model is a new approach to writing parallel programs that combines MPI and UPC in the same program. This model has several important benefits. It provides MPI programs with access to a large distributed shared global address space with significant advantages when compared with MPI-2 one-sided communication. It provides UPC programmers with an additional level of locality control that can be used to create multiple UPC spaces connected via MPI. Finally, it can provide access to libraries written in either model, e.g. access to PETSc and ScaLAPACK for UPC programmers.

This page is intended to serve as early documentation on hybrid parallel programming using MPI and Unified Parallel C.

Contents

Papers

Hybrid Parallel Programming with MPI and Unified Parallel C pdf
James Dinan, Pavan Balaji, Ewing Lusk, P. Sadayappan, Rajeev Thakur.
Proc. 7th ACM Conf. on Computing Frontiers (CF). Bertinoro, Italy. May 17-19, 2010.

Building the Environment

Many hybrid MPI and UPC setups are possible. In our work, we have used the GCCUPC compiler with the Berkeley UPC runtime. The instructions here are focused on building the hybrid setup on an Infiniband cluster. MPI and the BUPC runtime must be build with a compiler that is ABI compatible (i.e. produces binaries that can be linked by) GCC.

WARNING

The current state of the hybrid MPI+UPC environment is in the proof-of-concept phase. We are working to improve the level of support and interoperability, but at present there are many caveats and challenges involved in setting up the environment. Expect things to be broken right now.

GCCUPC

  1. Download GCCUPC [1]
  2. Untar the source code
  3. Make a separate build directory
  4. Run configure from the build directory, no special options are needed
  5. Build and install GCCUPC

Berlekey UPC Runtime

  1. Download the BUPC runtime system [2]
  2. Configure the runtime with the following options:
    1. ...
  3. Build and install the BUPC runtime

MPI

Build and install MVAPICH [3]. No special options are needed.

Hydra Process Manager

Build and install the Hydra process manager.

Writing Hybrid Codes

Running Hybrid Codes

Personal tools