Author profiling evaluator fixed

21 views
Skip to first unread message

Francisco Rangel

unread,
Apr 17, 2017, 6:47:15 AM4/17/17
to pan-workshop-series, p...@webis.de
Dear participants,

The evaluator for the author profiling task has been fixed. 

Please, reevaluate your submissions and let us know any possible inconvenience.

Best regards,

--
Francisco M. Rangel Pardo
CTO Autoritas Consulting S.A.
Twitter: @kicorangel

Helena Gomez

unread,
Apr 17, 2017, 1:50:48 PM4/17/17
to PAN Workshop Series on Digital Text Forensics, p...@webis.de

Hi Francisco,

The evaluator is still giving me an error. I don't know if it is still the evaluator's problem or if it is my output.
This is the error:

Exception in thread "main" java.io.FileNotFoundException: /media/test-datasets-truth/author-profiling/pan17-author-profiling-test-dataset-2017-03-16/truth.txt/es.txt (No such file or directory) at java.io.FileInputStream.open(Native Method) at java.io.FileInputStream.<init>(FileInputStream.java:146) at java.io.FileInputStream.<init>(FileInputStream.java:101) at java.io.FileReader.<init>(FileReader.java:58) at evalpan17.EvalPAN17.LoadTruth(EvalPAN17.java:97) at evalpan17.EvalPAN17.main(EvalPAN17.java:50)

You can check in my VM, the user is markov17.

Thank you for your help, regards.

Helena Gómez

Francisco Rangel

unread,
Apr 17, 2017, 1:53:43 PM4/17/17
to pan-workshop-series, p...@webis.de
Thanks Helena, this is due to the second parameter. 

Martin, please, could you change the second parameter to pass only the path to the training set, without the truth.txt.

That is, only:

 /media/test-datasets-truth/author-profiling/pan17-author-profiling-test-dataset-2017-03-16/

Best, 

--
--
You received this message because you are subscribed to the Google Group "PAN".
Visit this group at http://groups.google.com/group/pan-workshop-series
To unsubscribe send email to pan-workshop-series+unsub...@googlegroups.com.
---
You received this message because you are subscribed to the Google Groups "PAN Workshop Series on Digital Text Forensics" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pan-workshop-series+unsub...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Khaled Alrifai

unread,
Apr 24, 2017, 2:50:17 AM4/24/17
to PAN Workshop Series on Digital Text Forensics, p...@webis.de
Dear Mr.Francisco,

I face the same problem with running my predictor as jar file of JAVA, the input test data is empty, When I use the path " /media/test-datasets-truth/author-profiling/pan17-author-profiling-test-dataset-2017-03-16/" no results shown, but the evaluator return NullPointerException. Any help please ... the deadline becomes near and I couldn't show the results till now. Thanks in advance.

Martin Potthast

unread,
Apr 24, 2017, 3:42:22 AM4/24/17
to Khaled Alrifai, PAN Workshop Series on Digital Text Forensics, p...@webis.de
Hi Khaled,

as mentioned in my previous mail, you'll have to refer to the dataset using the variable $inputDataset in your command on TIRA.

Best,
Martin
--
Dr. Martin Potthast
Bauhaus-Universität Weimar
Digital Bauhaus Lab
Bauhausstr. 9a
99423 Weimar
Germany

+49 3643 58 3567
+49 171 809 1945

www.potthast.net
Reply all
Reply to author
Forward
0 new messages