Training GraphLab classifier on EC2 GPU instance

User 1251 | 2/1/2015, 9:27:55 PM

I'd like to train a very big/slow neural net on an Amazon EC2 GPU instance. If I run a job on an Amazon EC2 GPU instance, will GraphLab automatically recognize that it can use the GPU even if I have the non-GPU version installed (as I'm running OS X, not Linux)?

Comments

User 92 | 2/2/2015, 11:14:31 PM

Hi,

Unfortunately we do not support running a job in EC2 that can leverage GPU yet. we are working on that support now and you should be able to use that in future release. We will also consider the requirement of being able to launch GPU EC2 instance from non-GPU GraphLab Create client.

For now, the way you may leverage the GPU is to launch an EC2 instance yourself, ssh to the machine, install appropriate driver and GraphLab Create GPU version there. Check out the following notebook for example regarding how to leverage GPU for training a neural network: http://dato.com/learn/gallery/notebooks/buildimagenetdeeplearning.html

Hope this helps and please let us know if you have additional information.

Ping


User 1700 | 4/1/2015, 10:46:18 AM

FYI you can run an EC2 instance that has everything you need pre-installed. Use this AMI https://www.kaggle.com/forums/f/208/getting-started/t/11505/an-aws-ami-mainly-for-deep-learning

I tried this and it works like a charm.