memcacheq question
1 view
Skip to first unread message
ethane
Oct 3, 2008, 12:54:07 PM10/3/08
to memcachedb
Hello,
We are interested in this project, but would like to know if there is
any way to fetch a item from the queue, but have a way of surviving a
failure while processing that job. Specifically this flow is what we
worry about:
Process 1:
1. Get request
2. Process and store job
set <Q> x x 10
<body>
STORED
Process 2:
1. get <Q>
VALUE <Q> x x 10
<body>
2. Process <body>
_exception_
3. Job is now gone
Can you imagine a way to protect against this scenario? In our
current queueing scenario, we are able to lock an entry from
retrieval, and then we have a lock manager that kills stale locks and
reinserts the job in queue.
Any ideas?
Ethan
We are interested in this project, but would like to know if there is
any way to fetch a item from the queue, but have a way of surviving a
failure while processing that job. Specifically this flow is what we
worry about:
Process 1:
1. Get request
2. Process and store job
set <Q> x x 10
<body>
STORED
Process 2:
1. get <Q>
VALUE <Q> x x 10
<body>
2. Process <body>
_exception_
3. Job is now gone
Can you imagine a way to protect against this scenario? In our
current queueing scenario, we are able to lock an entry from
retrieval, and then we have a lock manager that kills stale locks and
reinserts the job in queue.
Any ideas?
Ethan
Steve Chu
Oct 5, 2008, 10:27:55 PM10/5/08
to memca...@googlegroups.com
Hi, Ethan,
We have discussed this issue, following this link:
We do not provide explicit deletion, so you should do this by
yourself. For example, when you get a message from Q1 successfully,
then at same time, append this message to Q2. When you have processed
this message successfully, then also consume it from Q2. But this will
introduce the complex to the application.
Regards,
--
Steve Chu
http://stvchu.org
Reply all
Reply to author
Forward
0 new messages