Difference between log entropy model and tfidf

[nilz]

Hello gensim users,

I was wondering if someone could point me at some literature in IR
research that discusses the difference between log entropy and tfidf?
Some works I have seen on an initial search use the two synonymously
while there are others that tend to make some distinction.

For my data set, I get much better results with the log entropy model
as opposed to with tdidf and I want to understand and document the
differences between the two.

Thanks
Nilz

[Stephan Gabler]

Hey Nilz,

I implemented the log entropy model after reading this article:

An empirical evaluation of models of text document similarity
MD Lee, B Pincombe… - … of the 27th Annual Conference of the …, 2005

http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.111.7144&rep=rep1&type=pdf

hope this helps,

stephan

[Dan Howarth]

Could you explain how this can be used to create LSA model with the gensim library?