Problems with NR CIF Timetable this morning

[petermount]

This mornings timetable update has failed, but this time with a new error.

Instead of the CIF I'm receiving

<?xml version="1.0" encoding="UTF-8"?>

<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Expires>2015-04-04T09:27:12Z</Expires><ServerTime>2015-04-04T09:27:30Z</ServerTime><RequestId>868EAEEED369A0F3</RequestId><HostId>Xixv1zVcwYCWU0RtcX9wYez0GCfNamdRNZk43apQOk0uwLxVnGsVWu6iWUfjKB0J8KShWXxcPXA=</HostId></Error>

 I've tried this from the browser rather than from the script & I get the same error (different values).

Any ideas anyone?

Peter

[Chris Bailiss]

I managed to retrieve the full file at 4:30 this morning, so the problem has developed since then.

Given the error, it suggests something might be running on the wrong time (the authentication is based around time-limited tokens if memory serves, so a clock set wrongly might cause an error like this).

Needs support to look into it... I assume you've fired off an email to support.

Chris

[petermount]

On Saturday, 4 April 2015 13:12:23 UTC+1, Chris Bailiss wrote:

I managed to retrieve the full file at 4:30 this morning, so the problem has developed since then.

Given the error, it suggests something might be running on the wrong time (the authentication is based around time-limited tokens if memory serves, so a clock set wrongly might cause an error like this).

Needs support to look into it... I assume you've fired off an email to support.

I thought I had send it to support but just noticed it was stuck in drafts - now sent adding that it was working at 0430.

Peter

[Hayden Dunnicliffe]

+1 I've also been having trouble downloading the update schedule for today.

[Peter Mount]

I didn't get a response from support yesterday but it did work late in the evening.

That said today is been the same, so something isn't right with it.

I'll try it again later.

Peter

--
You received this message because you are subscribed to the Google Groups "A gathering place for the Open Rail Data community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openraildata-t...@googlegroups.com.
To post to this group, send email to openrail...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Raj Chevli]

+1 for me too. It seems like a permissions error on amazon S3 or they haven't uploaded it. I wonder if it is a manual process to put it on the S3 bucket and with it being the easter weekend, it hasn't been uploaded. I will try tomorrow.

[Peter Hicks]

Hi Raj

On 06/04/15 13:41, Raj Chevli wrote:
> +1 for me too. It seems like a permissions error on amazon S3 or they
> haven't uploaded it. I wonder if it is a manual process to put it on
> the S3 bucket and with it being the easter weekend, it hasn't been
> uploaded. I will try tomorrow.

It's an automatic process.

Files are generated and uploaded, and each time you call the
/CifFileAuthenticate code, it generates an Amazon S3 'signed' URL, which
is valid for five minutes or so.

By the looks of the error message, the times being generated are an hour
out.

I've no idea why this has just happened now, and I don't have any remote
access to the server to find out, so we'll have to wait for the official
line from Support on Tuesday.


Peter

[Peter Mount]

I'll add it's happening for me again. If it gets cleared tomorrow I'll do a fresh full import from the last full run as I know I'm missing one now from yesterday.

It's a bit odd as it can't be the usual culprit of a  time zone change. We changed after the us so it's not that scenario.

[petermount]

Any update on this Peter?

I've just tried it again and it's still happening with the same issue - the expiry time being about 2 minutes before the server time.

Thanks

Peter

[Chris Bailiss]

If the fix is more complex than just resetting a clock somewhere, would it be possible to make the files since Friday evening (I use the CIF ones) available in an alternative location?

Not sure whether this would work for others, but would certainly be a workable interim solution for me.

Thanks

Chris

[Peter Hicks]

On 07/04/15 13:50, petermount wrote:
> Any update on this Peter?
>
> I've just tried it again and it's still happening with the same issue
> - the expiry time being about 2 minutes before the server time.

I've reported it internally but nothing so far - I'll keep on at the
right people (who are a few hundred miles away from me)


Peter

[petermount]

I'm the same as you, I use the CIF so I'd need the same set as well.

Peter

[kai.g...@network-plus.co.uk]

On Saturday, 4 April 2015 10:31:33 UTC+1, petermount wrote:

Chaps,

I've been unable to pull the CIF file for three days. Looks like it could be a timezone issue, but it worked each day since BST clock change last weekend...

Kai

[Peter Hicks]

All,

The problem's sorted now - it was clock drift on a server causing the Amazon S3 signed URLs to be generated with an expiry time in the past, as the TTL is only 1-2 minutes.

All the files generated over the weekend are up on S3 and available for download.


Peter

[kai.g...@network-plus.co.uk]

Thanks!

Kai

[Hayden Dunnicliffe]

Yep, looks good to me. Thanks, for sorting this! 

Of course it had to happen during a 4 day bank holiday haha, typical. 

[Dave Butland]

I have just checked my files and they seem correct (DFROC1U, DFROC1V and DFROC1W respectively). I have the originals if you want them. Can stick them up on a standard http connection if Peter doesn't mind.