TD feed problems again

[Peter Hicks]

Hello

Is anyone else experiencing problems with the TD feed?

https://monitor.opendata.opentraintimes.com/d/Wo-4XDVik/network-rail-open-data?orgId=1&from=1528281949348&to=1528289149348

I'm getting missed steps galore on my maps.

Peter

OpenTrainTimes Ltd. registered in England and Wales, company no. 09504022.

Registered office: 13a Davenant Road, Upper Holloway, London N19 3NW

[Phil Wieland]

Yes, and on the TRUST feed as well.

[Peter Hicks (Poggs)]

> On 6 Jun 2018, at 13:49, Phil Wieland <goo...@philwieland.com> wrote:
>
> Yes, and on the TRUST feed as well.

[screams internally]

--

[Adrian Bradshaw]

Yes. Our diagrams are a mess due to missed steps

---

Adrian Bradshaw – Administrator (volunteer)

Railcam UK Limited

@: adr...@railcam.uk

Railcam.uk – Bringing The Lineside To Your Armchair

Railcam UK Limited | A company limited by guarantee | registration number 10167844

3rd Floor | 207 Regent Street | London W1B 3HH

Railcam UK Ltd is operated on a not-for-profit basis entirely by volunteers

--
You received this message because you are subscribed to the Google Groups "A gathering place for the Open Rail Data community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openraildata-t...@googlegroups.com.
To post to this group, send email to openrail...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[petermount]

It seems to have settled down since 1300UTC

[Phil Wieland]

And broken again at 14:22Z.

[petermount]

You beat me too it.

It's flapping like mad

[petermount]

The TD feed seems to have stabilised since 17:24 UTC

[Mark Rawlinson]

Good news on the face of it, but I'm still seeing lots of missing messages and 60 seconds latency

on the TD feed, and that delay is not gradually 'catching up' as normally happens when the feed

recovers so it looks like the TD feed is still broken, but in a more subtle way which is not immediately

obvious from the performance graphs?

MARK 

[Phil Wieland]

No, it's still missing umpteen berth steps.  (And incidentally showing 60 seconds of latency.) 

On Wednesday, June 6, 2018 at 6:37:45 PM UTC+1, petermount wrote:

[Phil Wieland]

Broken again since 06:30z this morning.

[Where-in-Sussex]

Looking this morning at your graph and the actual output.... we are missing messages as nowhere near normal weekday peak and can see duplicate ID ie missing steps plus 2 min behind

[Adrian Bradshaw]

It looks to me (without any actual measurement), that the message rate is a fraction of what it should be. Perhaps 10%.

 

No acknowledgement of the issue on the Twitter feed yet. Are we in for another day of the service being effectively useless?

 

<sarcasm>Fortunately, up here in the Northern franchise area, there are hardly any trains running anyway so perhaps nobody will notice - or care.</sarcasm>

 

---

Adrian Bradshaw – Administrator (volunteer)

Railcam UK Limited

@: adr...@railcam.uk

Railcam.uk – Bringing The Lineside To Your Armchair

Railcam UK Limited | A company limited by guarantee | registration number 10167844

3rd Floor | 207 Regent Street | London W1B 3HH

Railcam UK Ltd is operated on a not-for-profit basis entirely by volunteers

[Phil Wieland]

Just in case no-one else has, I have raised Ticket#2018060700000318.

[Peter Hicks (Poggs)]

On 7 Jun 2018, at 09:02, Adrian Bradshaw <adr...@railcam.uk> wrote:

It looks to me (without any actual measurement), that the message rate is a fraction of what it should be. Perhaps 10%.

No acknowledgement of the issue on the Twitter feed yet. Are we in for another day of the service being effectively useless?

<sarcasm>Fortunately, up here in the Northern franchise area, there are hardly any trains running anyway so perhaps nobody will notice - or care.</sarcasm>

If you compare the message volumes now and at the same time yesterday (https://monitor.opendata.opentraintimes.com/d/Wo-4XDVik/network-rail-open-data?orgId=1&from=1528243553676&to=1528358753676), you can see the chunk of messages missing - at 0800 yesterday, it was 186 messages/minute, and today it was only 172.

Consider each message from NROD contains 32 TD messages - that’s about 400 messages/minute missing, which is a large number irrespective of the percentage of the total feed.

Peter

[Adrian Bradshaw]

Thanks Phil.

I may have missed it, but I don't recall seeing so much as an official acknowledgement of the problem. There is nothing on the Twitter feed since 16th May. Could it be that nobody there has noticed and the usual resigned "here we go again" grumbles, from the same 5 or 6 folk here, haven't been noticed either?

 

---

Adrian Bradshaw – Administrator (volunteer)

Railcam UK Limited

@: adr...@railcam.uk

Railcam.uk – Bringing The Lineside To Your Armchair

Railcam UK Limited | A company limited by guarantee | registration number 10167844

3rd Floor | 207 Regent Street | London W1B 3HH

Railcam UK Ltd is operated on a not-for-profit basis entirely by volunteers

--

[Mark Rawlinson]

Looks like CACI must be running the London Stock Exchange pricing data feed now too:

https://www.bbc.co.uk/news/business-44395093

Perhaps that's why they are too busy to post replies on here/respond to tickets, etc!

MARK

[Phil Wieland]

Now both TD and TRUST seem to be dropping messages.

[Adrian Bradshaw]

No response to your ticket, I assume?

 

---

Adrian Bradshaw – Administrator (volunteer)

Railcam UK Limited

@: adr...@railcam.uk

Railcam.uk – Bringing The Lineside To Your Armchair

Railcam UK Limited | A company limited by guarantee | registration number 10167844

3rd Floor | 207 Regent Street | London W1B 3HH

Railcam UK Ltd is operated on a not-for-profit basis entirely by volunteers

On 2018-06-07 14:39, Phil Wieland wrote:

Now both TD and TRUST seem to be dropping messages.

 

--

[Phil Wieland]

Nope.

[Adrian Bradshaw]

So, in two days, not so much as an acknowledgement of a problem?

 

https://twitter.com/open_rail_feeds?lang=en-gb

 

 

---

Adrian Bradshaw – Administrator (volunteer)

Railcam UK Limited

@: adr...@railcam.uk

Railcam.uk – Bringing The Lineside To Your Armchair

Railcam UK Limited | A company limited by guarantee | registration number 10167844

3rd Floor | 207 Regent Street | London W1B 3HH

Railcam UK Ltd is operated on a not-for-profit basis entirely by volunteers

[Mark Rawlinson]

As they are clearly not trying to fix (or even acknowledge) the issue in a timely manner, 

doesn't that mean that CACI are now in default with regard to their contract to supply 

and maintain the NR data open data feeds to their customers (i.e. us!), many of whom

use the feeds to run popular websites and services, in turn letting down tens of thousands

of end users??

 

If so, is there a way to contact/discuss the issue directly with a senior manager,

rather than faffing around with all this support ticket and twitter nonsense?

MARK

[Phil Wieland]

Still broken this morning.  I have given up and blanked my public diagrams.

[Where-in-Sussex]

I emailed David Higginbottom and have received and out of office message until 11/6/18

[Where-in-Sussex]

I have also emailed the person listed for Out of Hours support escalation in his email

[Adrian Bradshaw]

I suggested, privately to someone yesterday that perhaps David was away from work and no provision had been made for cover.

 

The out-of-office reply suggests that may be correct. It's certainly no excuse.

 

I have posted the following on our diagrams in response to complaints we are receiving from our donors/supporters (diagram users).

 

WE APOLOGISE FOR THE CONTINUING PROBLEMS WITH OUR DIAGRAMS

This is due to a persistent problem with the Network Rail data feeds. The data which we and other websites are receiving is incomplete and often delayed, which results in 'stuck' headcodes and misleading information.

This is completely beyond our control and we are trying, so far without success to have the problem acknowledged and investigated by the company responsible for delivering the feeds. At time of writing (08/06/2018 09:00), there has been no response, despite representatives of Railcam and other well-known sites raising the issue through the limited channels available to us.

 

---

Adrian Bradshaw – Administrator (volunteer)

Railcam UK Limited

@: adr...@railcam.uk

Railcam.uk – Bringing The Lineside To Your Armchair

Railcam UK Limited | A company limited by guarantee | registration number 10167844

3rd Floor | 207 Regent Street | London W1B 3HH

Railcam UK Ltd is operated on a not-for-profit basis entirely by volunteers

--

[Allan Blundell]

Got a reply in the last couple of minutes.

Dear Allan Blundell,

Thank you for contacting NROD Support.
 
Thanks for raising the issue - I'm working on the problem and I'll notify you when I've found a solution.

Thanks,

Joshua Kitchen
NROD Support

[Phil Wieland]

I've just received a reply to my ticket, stating that they are working on the problem.

Phil

On Wednesday, June 6, 2018 at 1:46:57 PM UTC+1, Peter Hicks wrote:

Hello

Is anyone else experiencing problems with the TD feed?

https://monitor.opendata.opentraintimes.com/d/Wo-4XDVik/network-rail-open-data?orgId=1&from=1528281949348&to=1528289149348

I'm getting missed steps galore on my maps.

Peter

[Where-in-Sussex]

I see the fault is still there when the peak kicks in. Seems to be message volume related. Only weekdays once it gets busy.

[Phil Wieland]

There was also a similar looking outage around 20:00 yesterday.  Lasted about 50 minutes.

[Peter Hicks]

Thanks, I missed that one!  Duly noted on https://monitor.opendata.opentraintimes.com/d/Wo-4XDVik/network-rail-open-data?orgId=1&from=1528618038249&to=1528704438250, as well as this morning's message loss.

Peter

--

You received this message because you are subscribed to the Google Groups "A gathering place for the Open Rail Data community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openraildata-t...@googlegroups.com.
To post to this group, send email to openrail...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Russell Bowman]

My own feed monitoring is fairly new and buggy, so treat with care, but the TD latency looks suspiciously glued to 60 seconds.