announcing asyncmongo for accessing mongodb from tornado

[Jehiah Czebotar]

Hi All.

I'm happy to announce a new project i've been working on, which is an
asynchronous library for accessing mongodb built on top of the tornado
ioloop.

https://github.com/bitly/asyncmongo

At bit.ly, we have been very happy with tornado, and we are excited to
continue building applications on top of tornado, and we are also
excited about how this library will help enable that. While not 100%
feature complete when compared to pymongo, it is stable at it's
current v0.1 release and is starting to see production deployment at
bit.ly

cheers!
--
Jehiah

[HENG]

Cool! Thank!

2010/11/18 Jehiah Czebotar <jeh...@gmail.com>

--
--------------------------------------------------------------------
HengZhou
---------------------------------------------------------------------
--

[(felinx)飞龙在天]

That's really good news, cheer!

--
Felinx Lee

What powered sites?
http://poweredsites.org

What can change the nature of a man?(Planescape Torment)
http://en.wikipedia.org/wiki/Planescape:_Torment

[Francisco Souza]

On Thu, Nov 18, 2010 at 12:26 AM, Jehiah Czebotar <jeh...@gmail.com> wrote:
Hi All.

I'm happy to announce a new project i've been working on, which is an
asynchronous library for accessing mongodb built on top of the tornado
ioloop.

Hi Jehiah,
totally amazing!

Congratulations ;)

Keep hackin,
Francisco Souza
Software developer at Giran and also full time
Open source evangelist at full time

English: http://www.franciscosouza.com
Portuguese: http://www.franciscosouza.com.br
Twitter: @franciscosouza
+55 27 3026 0264

[Romy]

Very cool!

We just started using Mongo w/ our Tornado deployment, and had some
discussions about precisely this. We decided to go ahead w/ Mongo
without true async support because most of our use cases were fire-and-
forget write calls, but being able to execute queries async could
become very useful.

So I presume while Mongo is handling queries, Tornado can handle other
requests, yes ?

Keep it up,

R

[soupy]

This looks amazing, thank you for making this available. I was just
starting to look into using mongodb with tornado so your timing could
not have been better.

--Craig

[Joe Bowman]

Hey awesome, I've been using pymongo with Tornado for everything on
unscatter.com and will definitely take a look at this if I ever get a
chance to work on it again.

On Nov 17, 9:26 pm, Jehiah Czebotar <jeh...@gmail.com> wrote:

[Joe Bowman]

Question. I see the option to designate tailable cursor objects, is
this fully implemented meaning that it won't block at all? I've been
considering implementing redis just for the publish/subscribe
functionality for one part of my project, but if this can handle
tailable cursors without blocking I can use mongodb for everything.

[Jehiah Czebotar]

hmm i've not used tailable cursors at all, so asyncmongo doesn't have
anything for that baked in at the moment. There might be some
challenges with when a tailable cursor would have it's connection
released for re-use, but there might not be (i'd have to read more
about how mongo implements them). In any case, feel free to fork on
github and give it a try adding support.

--
Jehiah

[Joe Bowman]

Will do when I can find some time, unless someone else beats me to it.
I'm about to dive back into my own oss project for appengine sessions
so will be consumed with that for a while.

[Joe Bowman]

Actually, it looks like tailable cursor doesn't have the functionality
I need, I'll probably have to take a look at redis regardless. It
really is temporary data so redis probably a better fit over all for
it anyway.

[Victor Pantoja]

Congrats!

I really liked asyncmongo! We have a high performance application and we were using pymongo.

Now, we've just refactored our code to use asyncmongo and achieved much better results:

pymongo: 1200 requests/s
asyncmongo: 2500 requests/s

These load tests were performed under the same conditions.

Thank you a lot! I hope you keep up the good working.

Victor

2010/11/18 Jehiah Czebotar <jeh...@gmail.com>

[Didip Kerabat]

Just a suggestion for the community,

Tornado website needs to keep track of high profile users (such as bit.ly).

it's a good marketing opportunity for the framework, I think.

- Didip -

[Phil Plante]

I agree it would be good to list more of the higher profile sites on
tornadoweb.org. Although FriendFeed and Facebook are already
mentioned there...