Finding the ideal number of topics when using LDA Seq model
36 views
Skip to first unread message
Jacob Celestine
unread,
Jul 22, 2022, 9:18:33 AM7/22/22
Reply to author
Sign in to reply to author
Forward
Sign in to forward
Delete
You do not have permission to delete messages in this group
Copy link
Report message
Show original message
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to Gensim
Hi,
I am trying to use the Gensim LDA Seq model to identify topics that change over time. I have 8 time slices, each having data from a decade. I tried using the NPMI score to identify the ideal number of topics to use, but I got split results :
Two time-slices found 10 topics as the best.
Three time-slices found 14 topics as the best.
Three time-slices found 17 topics as the best.
In this scenario, how should I proceed? Should I take a look at another metric, or look at the quality of the topics themselves? Or is there another approach that I can take?