Delaying message visiblity

5,628 views
Skip to first unread message

Thiren Bunsee

unread,
Jul 24, 2017, 10:52:14 AM7/24/17
to Google Cloud Pub/Sub Discussions
Hi,

I wanted to find out if there is a way to delay message delivery when using the pubsub queue? For example, if I publish a message with a delay of 60 seconds then it will only be visible to subscribers after a 60 second timer has elapsed.

There is a feature on AWS SQS that works like this and I was hoping that GCP would have a similar feature: http://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-message-timers.html

Regards

Kir Titievsky

unread,
Jul 24, 2017, 11:03:45 AM7/24/17
to Google Cloud Pub/Sub Discussions, Thiren Bunsee
Thiren,

You will find this feature in the  App Engine Task Queues.  

You can get a similar effect with a Pub/Sub I'd your are willing to add a bit of application logic: whenever your app sees a message, it will check the auto generated time stamp on the message and modifyAckDeadline for the message by 10 minutes if the message is brand new. The newew versions of Java and Go client libraries will handle this automatically: so you just do nothing with a message for X minutes.  You would configure the maximum extension time used by the client in this case so that messages are not longer than you want.  


If the delay is fixed across messesges and less than 10 minutes, you can set the default back deadline for the subscription to the delay. Then rely on delivering messages twice: the first time, your app just drops message.  

--
You received this message because you are subscribed to the Google Groups "Google Cloud Pub/Sub Discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-pubsub-dis...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-pubsub-discuss/17878c60-9db4-4a6a-af83-0a5de057f308%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--

Kir Titievsky | Product Manager | Google Cloud Pub/Sub

Thiren Bunsee

unread,
Jul 24, 2017, 11:33:38 AM7/24/17
to Google Cloud Pub/Sub Discussions, thiren...@gmail.com
Hi,

Thanks for the reply. I am actually using the pubsub queue to trigger cloud functions and as far as I'm aware the message is acknowledged when a function is triggered. I would also prefer not to trigger multiple functions per message, it defeats the purpose of using them if I have to incur usage costs to pole messages. Lastly, the delay is not fixed.

Would you know if there are any plans for implementing this type of feature at a future date?

Regards

On Monday, 24 July 2017 17:03:45 UTC+2, Kir Titievsky wrote:
Thiren,

You will find this feature in the  App Engine Task Queues.  

You can get a similar effect with a Pub/Sub I'd your are willing to add a bit of application logic: whenever your app sees a message, it will check the auto generated time stamp on the message and modifyAckDeadline for the message by 10 minutes if the message is brand new. The newew versions of Java and Go client libraries will handle this automatically: so you just do nothing with a message for X minutes.  You would configure the maximum extension time used by the client in this case so that messages are not longer than you want.  


If the delay is fixed across messesges and less than 10 minutes, you can set the default back deadline for the subscription to the delay. Then rely on delivering messages twice: the first time, your app just drops message.  
On Mon, Jul 24, 2017 at 10:52 AM Thiren Bunsee <thiren...@gmail.com> wrote:
Hi,

I wanted to find out if there is a way to delay message delivery when using the pubsub queue? For example, if I publish a message with a delay of 60 seconds then it will only be visible to subscribers after a 60 second timer has elapsed.

There is a feature on AWS SQS that works like this and I was hoping that GCP would have a similar feature: http://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-message-timers.html

Regards

--
You received this message because you are subscribed to the Google Groups "Google Cloud Pub/Sub Discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-pubsub-discuss+unsub...@googlegroups.com.

Kir Titievsky

unread,
Jul 24, 2017, 12:16:00 PM7/24/17
to Thiren Bunsee, Google Cloud Pub/Sub Discussions
Hi, Thiren, We are not planning to implement timed delivery in Pub/Sub in the near future.  Re-designing for task queues is likely your best path for success. 

On Mon, Jul 24, 2017 at 11:33 AM, Thiren Bunsee <thiren...@gmail.com> wrote:
Hi,

Thanks for the reply. I am actually using the pubsub queue to trigger cloud functions and as far as I'm aware the message is acknowledged when a function is triggered. I would also prefer not to trigger multiple functions per message, it defeats the purpose of using them if I have to incur usage costs to pole messages. Lastly, the delay is not fixed.

Would you know if there are any plans for implementing this type of feature at a future date?

Regards

On Monday, 24 July 2017 17:03:45 UTC+2, Kir Titievsky wrote:
Thiren,

You will find this feature in the  App Engine Task Queues.  

You can get a similar effect with a Pub/Sub I'd your are willing to add a bit of application logic: whenever your app sees a message, it will check the auto generated time stamp on the message and modifyAckDeadline for the message by 10 minutes if the message is brand new. The newew versions of Java and Go client libraries will handle this automatically: so you just do nothing with a message for X minutes.  You would configure the maximum extension time used by the client in this case so that messages are not longer than you want.  


If the delay is fixed across messesges and less than 10 minutes, you can set the default back deadline for the subscription to the delay. Then rely on delivering messages twice: the first time, your app just drops message.  
On Mon, Jul 24, 2017 at 10:52 AM Thiren Bunsee <thiren...@gmail.com> wrote:
Hi,

I wanted to find out if there is a way to delay message delivery when using the pubsub queue? For example, if I publish a message with a delay of 60 seconds then it will only be visible to subscribers after a 60 second timer has elapsed.

There is a feature on AWS SQS that works like this and I was hoping that GCP would have a similar feature: http://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-message-timers.html

Regards

--
You received this message because you are subscribed to the Google Groups "Google Cloud Pub/Sub Discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-pubsub-discuss+unsubscrib...@googlegroups.com.
--

Kir Titievsky | Product Manager | Google Cloud Pub/Sub

--
You received this message because you are subscribed to the Google Groups "Google Cloud Pub/Sub Discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cloud-pubsub-discuss+unsub...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cloud-pubsub-discuss/ed0a4520-b95e-48fe-b95e-41d87970f52f%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

David Xia

unread,
Aug 27, 2020, 11:32:34 AM8/27/20
to Google Cloud Pub/Sub Discussions
Just wanted to share that I noticed Pub/Sub supports retry policies [1] that are GA as of 2020-06-16 [2].

> If the acknowledgement deadline expires or a subscriber responds with a negative acknowledgement, Pub/Sub can send the message again using exponential backoff.
Reply all
Reply to author
Forward
0 new messages