Results 1 to 5 of 5

Thread: OpenCL on distributed systems.

  1. #1
    Junior Member
    Join Date
    May 2011
    Posts
    8

    OpenCL on distributed systems.

    Can OpenCL be used on distributed systems without the need of MPI? For instance, if I have a micro beowulf cluster of two computers, each one with a OpenCL video board, will can a single program use both?

    If it's possíble, could I have a example on how to do it? Else, would it work with MPI?

    Thanks in advance

  2. #2
    Senior Member
    Join Date
    Mar 2011
    Location
    Seoul
    Posts
    118

    Re: OpenCL on distributed systems.

    The scope of OpenCL is limited to a single node. You would need to use MPI in addition to OpenCL to accomplish what you want. I'm not quite sure how to go about load balancing heterogenous systems (CPUs + GPUs) so I'm sorry I can't give you more detail about that. Generally when executing MPI programs one would specify a list of hostname with the number of CPU cores for each node, but how would one also specify the GPUs, GPU cores, frequencies, etc?

    If you find some good info, please remember to share

  3. #3
    Junior Member
    Join Date
    May 2011
    Posts
    8

    Re: OpenCL on distributed systems.

    I have not tought of running on several GPUs, as there would be a HUGE communcation delay. But maybe, using the right parameters, on a proper problem, it would work quite well. I'll check some more and if I find any good stuff, I promise to post here.

    Lucas

  4. #4
    Senior Member
    Join Date
    May 2010
    Location
    Toronto, Canada
    Posts
    845

    Re: OpenCL on distributed systems.

    I don't understand these two sentences. They seem to say the opposite.

    For instance, if I have a micro beowulf cluster of two computers, each one with a OpenCL video board, can a single program use both?
    I have not tought of running on several GPUs, as there would be a HUGE communication delay.
    As Sean said, you can use MPI to communicate between nodes.
    Disclaimer: Employee of Qualcomm Canada. Any opinions expressed here are personal and do not necessarily reflect the views of my employer. LinkedIn profile.

  5. #5
    Senior Member
    Join Date
    Mar 2011
    Location
    Seoul
    Posts
    118

    Re: OpenCL on distributed systems.

    I talked with some people who are familar with distributed computing with GPUs, and they said for best performance there should be one GPU for each CPU core. That way each MPI slot on a node is dedicated to one GPU.

    Quote Originally Posted by LucasCampos
    For instance, if I have a micro beowulf cluster of two computers...
    If you're concerned about communication bandwidth, latency, and not going to use all the CPU cores intensively, then multiple GPUs in a single node will outperform multiple GPUs on different nodes. This assumes that you're motherboard has PCIe x16 for each GPU on that node.

Similar Threads

  1. OPENCL distributed computing.
    By ashwath in forum OpenCL
    Replies: 11
    Last Post: 01-18-2013, 04:03 AM
  2. Replies: 5
    Last Post: 07-31-2011, 03:22 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •