Running Graphlab on a heterogeneous cluster

User 251 | 4/23/2014, 8:43:15 PM

Hi,

I just start using GraphLab. I have a heterogeneous cluster with two kinds of machines: one with 4 cores and the other with 1 core. Is there any way to better utilize the full power of the cluster? Like running 4 instances on the beefy machine and running only 1 instance on the wimpy machine? I'm new to GraphLab. Thanks!

Comments

User 6 | 4/24/2014, 6:41:18 AM

Hi Vanessa, The 1 core machine may be too weak to effectively run GraphLab. We assume at least 2 cores. GraphLab may have a problem working with a cluster of machines which are too different in capabilities.


User 251 | 4/24/2014, 8:01:47 PM

Thanks Danny,

I will try to grab some powerful nodes. But is it possible to run graphlab on a heterogeneous cluster? I mean could I change the machine configure file so that one beefy machine could run more than 1 graphlab instance?


User 6 | 4/25/2014, 3:07:33 AM

Basically we recommend running one GraphLab instance per machine. The number of cores used on that machine is configurable parameter. But so far we assumed a global parameter for the number of cores for all of the machines.