Best regards,
From: AL-NATSHEH HusseinHello Eneko,
Sent: 17 May 2017 17:04
To: e.ag...@ehu.eus
Subject: [STS] Re: STS benchmark
I had the chance this week to run our system on STS Benchmark (with the settings of best run (Run1) of UdL Team as described in the system description paper, attached).
The results of 3 runs of our system were as follows:
run1: {'test_score': 0.72402797552941101, 'dev_score': 0.78979959199179273}
run2: {'test_score': 0.7240556918383606, 'dev_score': 0.78955107284385118}
run3: {'test_score': 0.72416070656332898, 'dev_score': 0.78937855000741974}
Average of the above 3 runs:
{'test_score': 0.724081458, 'dev_score': 0.7895764049}
I hope you can add this results to the STSBenchmak page with the following details:
STS 2017 Task System description Paper:
Al-Natsheh et al.
Type:
Constrained
Model:
RandomForest
Link to Paper (as in the provided BibTex file of SemEval):
http://www.aclweb.org/anthology/S17-2013
If you want to verify or reproduce the results, please goto:
https://github.com/natsheh/sensim
and run (python sts_benchmark.py) with the default parameters.
Thanks a lot and best regards,
Hussein AL-NATSHEH
UdL Team @ STS Task1
Tel: +33 7 51 53 94 82 - Fax: +33 4 78 77 23 75
To unsubscribe, send email to sts-semeval+unsubscribe@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups "STS SemEval" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sts-semeval+unsubscribe@googlegroups.com.
To unsubscribe, send email to sts-semeval...@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups "STS SemEval" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sts-semeval...@googlegroups.com.
Hi Hussein,I'll update the paper to include your STS benchmark numbers.We'll be posting a version of the paper to arxiv, so the numbers can certainly be included there. We should also be able to update the version hosted at nlp.arizona.edu. I'm in the process of asking whether we can still update the ACL anthology version before the workshop. After the workshop, there's a good process for updating papers.
Dan
To unsubscribe, send email to sts-semeval+unsubscribe@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups "STS SemEval" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sts-semeval+unsubscribe@googlegroups.com.
--
--
Website of task, http://alt.qcri.org/semeval2017/task1/
To post to this group, send email to sts-s...@googlegroups.com
To unsubscribe, send email to sts-semeval+unsubscribe@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups "STS SemEval" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sts-semeval+unsubscribe@googlegroups.com.
Dan
To unsubscribe, send email to sts-semeval...@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups "STS SemEval" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sts-semeval...@googlegroups.com.
--
--
Website of task, http://alt.qcri.org/semeval2017/task1/
To post to this group, send email to sts-s...@googlegroups.com
To unsubscribe, send email to sts-semeval...@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups "STS SemEval" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sts-semeval...@googlegroups.com.
--
--
Website of task, http://alt.qcri.org/semeval2017/task1/
To post to this group, send email to sts-s...@googlegroups.com
To unsubscribe, send email to sts-semeval...@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to a topic in the Google Groups "STS SemEval" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/sts-semeval/H3HFqz6GGfA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to sts-semeval...@googlegroups.com.
Dan
To unsubscribe, send email to sts-semeval+unsubscribe@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups "STS SemEval" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sts-semeval+unsubscribe@googlegroups.com.
--
--
Website of task, http://alt.qcri.org/semeval2017/task1/
To post to this group, send email to sts-s...@googlegroups.com
To unsubscribe, send email to sts-semeval+unsubscribe@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups "STS SemEval" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sts-semeval+unsubscribe@googlegroups.com.
--
--
Website of task, http://alt.qcri.org/semeval2017/task1/
To post to this group, send email to sts-s...@googlegroups.com
To unsubscribe, send email to sts-semeval+unsubscribe@googlegroups.com
You received this message because you are subscribed to a topic in the Google Groups "STS SemEval" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/sts-semeval/H3HFqz6GGfA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to sts-semeval+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
--
Website of task, http://alt.qcri.org/semeval2017/task1/
To post to this group, send email to sts-s...@googlegroups.com
To unsubscribe, send email to sts-semeval+unsubscribe@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups "STS SemEval" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sts-semeval+unsubscribe@googlegroups.com.
train dev test total ----------------------------- news 3299 500 500 4299 caption 2000 625 625 3250 forum 450 375 254 1079 ----------------------------- total 5749 1500 1379 8628
thanks for spotting it, corrected!
best
eneko
--
--
Website of task, http://alt.qcri.org/semeval2017/task1/
To post to this group, send email to sts-s...@googlegroups.com
To unsubscribe, send email to sts-semeval...@googlegroups.com
For more options, http://groups.google.com/group/sts-semeval?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups "STS SemEval" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sts-semeval...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.