Is there a way to see fast/memory efficient classification algorithms?

35 views
Skip to first unread message

Rob Renaud

unread,
Jul 28, 2011, 6:16:09 PM7/28/11
to mlc...@googlegroups.com
I am mostly interested in seeing how different algorithms perform on this 170 MB dataset :


As you can see, half of the algorithms ran on the dataset have either timed out or hit the memory limit.  Is it possible to sort classification algorithms by speed/memory usage, and only run ones that are likely to succeed?  I suspect anything that uses weka will hit the memory limit for example.

I have a tiny sample of the same dataset at http://mlcomp.org/datasets/871


Zeno Gantner

unread,
Jul 29, 2011, 3:17:20 AM7/29/11
to mlc...@googlegroups.com
Hi Rob,

I think your feature request makes sense.

If you are looking for another program that is likely to succeed on
your dataset,
try Vowpal Wabbit:
https://github.com/JohnLangford/vowpal_wabbit/wiki

Best regards,
Zeno

--
MyMediaLite Recommender System Library: http://ismll.de/mymedialite

Percy Liang

unread,
Aug 1, 2011, 11:10:01 AM8/1/11
to mlc...@googlegroups.com
Thanks for the feedback - I've added it to our issue tracker. In the
meantime, this text file (which is periodically updated) has the list
of all the runs in our system:
http://www.mlcomp.org/download/runs.txt
You can use a simple script to see which programs have failed the
least number of times.

-Percy

Reply all
Reply to author
Forward
0 new messages