User 84 | 3/5/2014, 6:32:11 PM
Hello, Is there any upper bound of input file or graph size in Graphlab for a specific hardware environment? Our cluster information is as following: 1 login node and 64 compute nodes. Each compute node has 16GB of RAM and 2 CPU sockets, each with quad core Intel Xeon 2.66GHz CPU.
I am working on processing a large dataset (10GB). I split the dataset as 8 and 17 sub-files, respectively. And then appointed 8 and 17 nodes to work for the job, respectivey. But every time the node crashed. The attachment is the log. It was stuck at the end. Thank.