Meaning of "word_ngrams max length of word ngram [1]"

352 views
Skip to first unread message

Zexceed

unread,
Mar 26, 2017, 8:15:33 AM3/26/17
to fastText library
Hi,

Having issues understanding this hyperparameter "word_ngrams max length of word ngram [1]"

1) Does this mean if I set it to 0, this is a pure character n gram embedding? (i.e. word vector not added)

2) What does it mean if I set it to 2 or 3? 
Kindly share some examples for understanding.

Thanks

slack

unread,
Apr 22, 2017, 11:26:18 AM4/22/17
to fastText library
My understanding, for example ,we have sentence piece like : " the model is a nice ... ", when we set word_ngram = 2, we have :  the_model model_is  is_a ..., but if we set maxn=2, it generates <t th e> <m mo od de el l> ...

in a word: word_ngram is the word level, and maxn /minn is the character level

correct me if i misunderstood! 

在 2017年3月26日星期日 UTC+8下午8:15:33,Zexceed写道:
Reply all
Reply to author
Forward
0 new messages