Eval in epic

30 views
Skip to first unread message

Omid

unread,
Aug 30, 2014, 11:37:54 PM8/30/14
to scalanlp...@googlegroups.com
I find that in Epic for running the test set for CRF, we should run this:

val stats = TaggedSequenceEval.eval(crf, test)

My question is where are the exact output of CRF on input and How can I access it?

Thanks

David Hall

unread,
Aug 30, 2014, 11:44:57 PM8/30/14
to scalanlp...@googlegroups.com
i don't follow?

Omid

unread,
Aug 30, 2014, 11:57:07 PM8/30/14
to scalanlp...@googlegroups.com, dl...@cs.berkeley.edu
My question is how can I get the output of CRF on the test set:
In your example you used: val stats = TaggedSequenceEval.eval(crf, test)
are the output labels in "stats" ?

David Hall

unread,
Aug 31, 2014, 12:05:02 AM8/31/14
to scalanlp...@googlegroups.com
oh, you mean the actual guesses? You have to do that separately, sadly. test.map(ts => crf.bestSequence(ts.words).render foreach println or something like that

Omid

unread,
Aug 31, 2014, 4:12:23 PM8/31/14
to scalanlp...@googlegroups.com, dl...@cs.berkeley.edu
Ahan, Okay, thanks ...

what is the default learning algorithm for your CRF implementation?  

David Hall

unread,
Sep 1, 2014, 4:06:08 AM9/1/14
to scalanlp...@googlegroups.com
are you using buildSimple? There's an OptParams object that has a few options in it (regularization, useStochastic, useL1) that control the regularization and kind of gradient minimizer used. The objective itself is log loss.

Omid

unread,
Sep 1, 2014, 12:29:53 PM9/1/14
to scalanlp...@googlegroups.com, dl...@cs.berkeley.edu
Yes, I'm using buildSimple
Reply all
Reply to author
Forward
0 new messages