Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.

Dismiss

ai:categorizer memory usage

7 views

Skip to first unread message

Thomas Krichel

unread,

Jul 15, 2009, 4:16:41 AM7/15/09

to Perl AI List, Илья Королёв

Hi, gang,

I sent a message to Ken Williams <ken...@gmail.com> but I have no
answer. Maybe some kind soul who has some familiarity with the
matter can have a look at this. I have a script and data at

http://wotan.liu.edu/home/krichel/tmp/ken_williams

I want to sort a set of refused documents for best fit to a set of
accepted documents. For each refused document, I train a set of all
documents except that single refused document, then test the single
refused document against that trained set. Here is my problem: at
each test the memory requirement of the running script seems to
increase. I have tried to free memory as much as I could by
unassigning the hypothesis object, the knowledge set object etc to
know avail, the memory hog slows down my machine to a crawl as the
number of tests conducted goes into the hundreds.

Any hints greatly appreciated!

Cheers,

Thomas Krichel http://openlib.org/home/krichel
RePEc:per:1965-06-05:thomas_krichel
skype: thomaskrichel

0 new messages