parallel python

[Anil]

Hi all,
I'm interested in parallelizing some code I have and came across this
long list of modules/libraries for distributed computing.

http://wiki.python.org/moin/ParallelProcessing

Has anyone used (and can recommend) any of these? I'm hoping to find
one that will help me go 'parallel' without having to completely tear
apart the code I already have.

Thanks
Anil

[Jake Hofman]

haven't used any of these myself, but have heard the "threading"
module is useful:

http://docs.python.org/library/threading.html

these blog posts may or may not be useful (hellmann's blog is good in general):

http://blog.doughellmann.com/2009/04/pymotw-multiprocessing-
part-1.html
http://blog.doughellmann.com/2009/04/pymotw-multiprocessing-
part-2.html

-j

[Will Martin]

Hi Anil,

Does the code take advantage of Cython yet? This can be a big speedup
and is much easier than going parallel.

http://cython.org/

Also, I'm at the SciPy conference right now and there were some
excellent discussions of the state of Parallel Python tools. Many of
the slides and videos of talks are posted here.

http://conference.scipy.org/

I would recomend the Cython talk and the panel discussion on parallel
computing. Hope this is somewhat helpful . . .

Best,
Will

[Anil Raj]

Wow! That's a lot of excellent info! Will keep me busy for a while. :)

Thanks a lot, Will and Jake.

Anil