Manual parameter search does not support custom evaluation metric

User 1319 | 10/29/2015, 4:51:01 AM

The graphlab.manual_search.create() does not support a custom evaluation function passed to the evaluator argument. My custom evaluation function works fine with graphlab.model_parameter_search.create() , but with graphlab.manual_search.create() it is ignored and the accuracy is used instead.

Note: I am using Graphlab 1.6.1.

Comments

User 19 | 10/29/2015, 5:32:30 AM

Hi,

Thanks for pointing this out. We will log this as a bug and let you know when a fix is available.

For now, I recommend using gridsearch or randomsearch.

Thanks again, Chris


User 1319 | 10/29/2015, 5:37:02 AM

Thanks Chris for your quick reply. Tarek