Is distributed LSA/LSI possible in Gensim on 1 machine ?
8 views
Skip to first unread message
Xiaoou Wang
Dec 5, 2021, 4:34:35 PM12/5/21
to Gensim
Hello community :)
I need to run LSA on some big corpus and for the moment i'm using the distributed LSA by running
python -m Pyro4.naming -n 0.0.0.0 &
on my machine then 16 times
python -m gensim.models.lsi_worker &
in the hope of using all my 16 cpu cores. Is this approach right and are there some more elegant way of doing multiprocessing LSA?
Tks in advance for any reply :)
Sincerely
Xo
Reply all
Reply to author
Forward
0 new messages