Stopping Pipelined Work Queue

33 views
Skip to first unread message

Michael Xavier

unread,
Nov 13, 2012, 2:25:24 AM11/13/12
to cellulo...@googlegroups.com
I'm working on a script which must parse a large XML file full of <release> tags. I've structured at the advice of tarcieri to be a chain of pools which asynchronously call eachother. It is all working but I've gotten to the point where I need to handle running out of data, but I need that to result in cascading shutdowns throughout the whole pipeline when all work is finished.

The overall pipeline goes like this: Parser -> NodeParser -> Converter (pushes to a queue).


Anyone have any suggestions? Signals seem inappropriate because you must block for those.

Ryan Cook

unread,
Nov 16, 2012, 2:48:40 AM11/16/12
to cellulo...@googlegroups.com
I replied with a comment in the gist. It's quite possible that I misunderstand your intention, but maybe my questions will help you somehow.

Ryan
Reply all
Reply to author
Forward
0 new messages