Negative log_perplexity

69 views
Skip to first unread message

Jonathan Peters

unread,
Aug 1, 2023, 2:41:25 PM8/1/23
to Gensim
Hello,

I created an LDA model from control data and I am trying to calculate the perplexity of my test data. I am using the ldamodel.log_perplexity function to do that.

Example: perplexity = lda_model.log_perplexity(test_corpus)

I am getting a negative output (-48.51) and I am wondering what exactly that means since in papers I've read, their output is positive.

Would be great if you can provide a source as well!
Reply all
Reply to author
Forward
0 new messages