User 956 | 11/24/2014, 9:32:18 PM
I have a question regarding the parallelism of GraphLab. I am currently working on implementing a graph algorithm in Python for GraphLab and asking myself how to parallelize the python execution. The algorithm can be mapped on the typical MapReduce paradigma. I calculate some stuff on a SFrame, after that I do a merge and repeat this several times. The stuff on the SFrame could be (logically) parallized. It is triggered by a for each loop. My question is, how can I parallelize this? Does GraphLab solve this problem on its own? Should I use another interface than the Python interface?
The algorithm looks like that (Spreading Activation) Start at a specific point in the graph Go to all neighbors and calculate a value for them (for all neighbors the same) Go to all neighbors-neighbors and calculate values for them and sum the values
As soon as I have implemented the algorithm I will publish it as how-to, blog post or discussion.
Thanks for your help! Tarek