RDM Darwin Push Port

[David Wheatley]

Hi all,

I've seemingly stopped receiving messages from the Kafka Darwin push port at around 07:15 after an initial slow-down around 07:11-07:12.

Is anyone else using the same feed, and have you noticed any problems too?

The normal NROD push port is still working as normal.

David

[Peter Hicks]

Hi David

On Monday, 17 November 2025 at 10:19, 'David Wheatley' via A gathering place for the Open Rail Data community <openrail...@googlegroups.com> wrote:

I've seemingly stopped receiving messages from the Kafka Darwin push port at around 07:15 after an initial slow-down around 07:11-07:12.

Is anyone else using the same feed, and have you noticed any problems too?

The normal NROD push port is still working as normal.

Good spot - I wonder why it's gone down.  I can't see anything that suggests the RDM connection is actually down, so it might be a problem with publishing data to Kafka.

It'd be a good idea, if you haven't already done so, to report it to RDM Support and as always, keep the group informed as to progress.

Best wishes,

Peter

[Alex Barber]

We are experiencing the same issue.

--
You received this message because you are subscribed to the Google Groups "A gathering place for the Open Rail Data community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openraildata-t...@googlegroups.com.
To view this discussion, visit https://groups.google.com/d/msgid/openraildata-talk/U42ky-HoEX062VkwTbivDHDEZzMKXYvP9AwwQBg1hzjllrZojkuV_2u2X3Y-pn6sRgWggr2J_k1lpJ7bUFbiwNupOFW36syjZTM8e8O4MmU%3D%40poggs.co.uk.

--

Alex Barber

[David Wheatley]

I raised ticket RDM0002945 and received the following reply:

Hello, thank you for letting us know. We are aware of the issue and the tech team are investigating. Will report back as soon as I have an update.

David

To view this discussion, visit https://groups.google.com/d/msgid/openraildata-talk/CAMB0V5UYpUJ1d%2B2HvFX457XYiOGxMj-DUf-h8GT3qWYXSS1Jiw%40mail.gmail.com.

[David Wheatley]

As a short and not-that-meaningful update, I received a burst of a few hundred messages around 13:14, but it stopped again within a minute. Some of the messages I received also arrived formatted with whitespace rather than the normal minified format, which I've not seen before.

Those messages were from around 13:04, rather than when the feed initially dropped out, so I think it's safe to say whatever messages have not been received since this morning are possibly going to be lost forever.

Hopefully the issue gets solved soon.

David

[Jez Smith]

For those who subscribe to this data product, the messages should have been coming through again from about 6pm last night.   Preliminary investigations suggest that a suppliers message queue had been deleted, but we are working with them to understand what happened and why and get to the root cause.

We don't believe that any messages will have been lost and the flow should be coming through in the correct order.

Apologies for the inconvenience and we will do what we can to avoid a reoccurrence.

Cheers

Jez

[David Wheatley]

Hi Jez,

Thanks for the explanation.

We don't believe that any messages will have been lost

No messages for the periods 0709-1303, 1306-1323, and 1324-1705 were received, so this simply isn't true. You can view exactly what data was sent on my archive: https://ilovetrains.co.uk/darwin-push-port/2025-11-17

and the flow should be coming through in the correct order.

Is this suggesting that the way partitions are configured on the feed has been resolved as part of the recovery from this outage?

David

To view this discussion, visit https://groups.google.com/d/msgid/openraildata-talk/3aa6add8-4e3a-45ad-a127-bb2c4c2576cfn%40googlegroups.com.