GraphChi: Value too large for defined data type

User 90 | 11/8/2014, 1:59:28 AM

I am trying to run GraphChi on large graphs, but I receive the following error:

<pre class="CodeBlock"><code>conversions.hpp(convertifnotexists:767): Did not find preprocessed shards for input.graph ESC[0mINFO: conversions.hpp(convertifnotexists:768): (Edge-value size: 52) ESC[0mINFO: conversions.hpp(convertifnotexists:769): Will try create them now... ESC[0mINFO: sharder.hpp(start_preprocessing:370): Starting preprocessing, shovel size: 3495253 ESC[0mESC[1;31mFATAL: conversions.hpp(convert_edgelist:217): Could not load :input.graph error: Value too large for defined data type ESC[0mterminate called after throwing an instance of 'char const*'</code></pre>

The odd thing is that the program works fine with smaller inputs. Please let me know how I can resolve this.

Comments

User 90 | 11/8/2014, 3:13:21 AM

It turns out fopen doesn't allow opening files greater than 2GB on 32-bit operating systems.

Source: http://stackoverflow.com/questions/1746751/fopen-failing-for-binary-file


User 1359 | 8/7/2015, 5:53:07 PM

Thanks for the follow up