Any interest in porting the JSON encoding and parsing over to Yajl?
The parser works similar to a SAX parser. Firing callbacks on found
tokens in the stream. Also the encoder allows you to retrieve and
clear it's buffer at any time, meaning you can stream the response as
it's being generated.
I took a quick look at the dbslayer source, and from what I can tell
the JSON parsing/decoding is pretty well decoupled from the http
layer. Can anyone speak to how large of a refactor it might be? I may
be able to lend a hand.
I think using Yajl would even further increase dbslayer's scalability
(especially in terms of memory usage).
It's sources are available here:
http://github.com/lloyd/yajl
Docs/Readme here:
http://lloyd.github.com/yajl/