[ANN] pubsub-logging released on pypi

45 views
Skip to first unread message

Takashi Matsuo

unread,
Apr 1, 2015, 1:16:13 PM4/1/15
to cloud-pubs...@googlegroups.com

Hi,

I have just uploaded pubsub-logging to pypi. This small library allows you to configure a Python logging handler to directly send the logs to Cloud Pub/Sub.

Pypi:

Source code:

Any feedback is welcome.

Enjoy :)

--
Takashi Matsuo | Developers Programs Engineer | tma...@google.com

Takashi Matsuo

unread,
Apr 18, 2015, 12:21:19 AM4/18/15
to cloud-pubs...@googlegroups.com

Hi,

I have just uploaded pubsub-logging-0.2.0, which has a new handler named AsyncPubsubHandler. This async version achieved 35k logs/sec on my workstation, whereas the old handler only achieve 5k logs/sec.

I think that this handler is also a good example of how to produce messages at high throughput with Python multiprocessing module. I also wrote a threading version (which is never released) and it only achieved 15k messages/sec.

The source code is available at:

Thanks,

Takashi Matsuo

unread,
Apr 22, 2015, 11:38:45 PM4/22/15
to cloud-pubs...@googlegroups.com
Hi,

Uploaded pubsub-logging-0.2.1. Only visible change is that now it fails fast when the specified topic doesn't exist.

Thanks,
Reply all
Reply to author
Forward
0 new messages