DataPoint system - planned maintenance on Wednesday 7 December 2016

[colin.corkerton]

Some planned maintenance of the Met Office's DataPoint system is scheduled for Wednesday 7 December between 1000 and 1200 UTC.

DataPoint should continue to be available during this time, but data may not update as normal. If you do experience any problems after this time please let us know as soon as possible by contacting enqu...@metoffice.gov.uk including DataPoint in the subject line.

Met Office change CRQ168546 covers this work.

[Tim H]

Hi Colin,

Thank you for the update.

A number of the weather resources we access have stopped returning the 3-day forecast.
We still get a valid JSON document with the parameters defined, but the data part is empty.

A sample of the site-ids that are returning empty response like this are:
320282:Aylesbury
310056:Crewe
350881:Chelsea

For example:

   http://datapoint.metoffice.gov.uk/public/data/val/wxfcs/all/json/320282?res=3hourly&key=[key]

I'm not sure whether this issue is related to the site maintenance or not, but we did start to experience this problem yesterday.

Thanks in advance,

Tim

[colinsjonesuk]

Hi Colin,

Thanks for the warning of planned maintenance.

Today, the data section of the XML seems to be missing. DataPoint is supplying the meta data section but the data section is empty.

Please advise if this problem could have been caused by the maintenance work?

Regards

Colin Jones

[Alan Fleming]

Hi Colin,

I'm also seeing similar problems to Tim and Colin below, and have noticed something that may be relevant.

I'm using Liverpool John Lennon Airport (location ID 26) as an example here. If I request the XML data 3 day forecast, I get only this as the forecast:

     <DV dataDate="2016-12-08T09:00:00Z" type="Forecast"/>

The time here is nearly 3 hours in the past.

However, if I change this request to use JSON instead, I get the following response, followed by a full forecast:

     "DV":{"dataDate":"2016-12-08T11:00:00Z","type":"Forecast"...

The time here is for the current hour, as I'd expect.

JSON data seems to work more often, but not in every case.

Hope this helps in some way.

Cheers

Alan

[Colin Jones]

Thanks Alan. I think that insight should be very useful for the team trying to solve the problem.

Regards

Colin

--
You received this message because you are subscribed to a topic in the Google Groups "Met Office DataPoint" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/metoffice-datapoint/5PSv-48Gt-k/unsubscribe.
To unsubscribe from this group and all its topics, send an email to metoffice-datapoint+unsub...@googlegroups.com.
To post to this group, send email to metoffice-datapoint@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[colin.corkerton]

Hi all,

Are you still experiencing any problems with missing data? This morning (Friday 9th) I have tried the various site ids mentioned below with my own API key and in each case the latest data is being returned.

Regards,

Colin

[Colin Jones]

Hi Colin, seems fine now thanks :-)

Kind Regards

Colin Jones

Sent from my Nexus 5x phone

--

[Tim Hastings]

Hi Colin,

It looks like thinks have settled down now.

Our last issue was at 12:57 and that was just one request failure whereas before we getting lots failures.

Thank you for the resolution.

I hope you have a great weekend.

Cheers,

Tim

On Fri, Dec 9, 2016 at 11:00 AM, Colin Jones <colins...@gmail.com> wrote:

Hi Colin, seems fine now thanks :-)

Kind Regards

Colin Jones

Sent from my Nexus 5x phone

On 9 Dec 2016 08:31, "colin.corkerton" <colin.corkerton@metoffice.gov.uk> wrote:

Hi all,

Are you still experiencing any problems with missing data? This morning (Friday 9th) I have tried the various site ids mentioned below with my own API key and in each case the latest data is being returned.

Regards,

Colin

On Wednesday, December 7, 2016 at 9:14:26 AM UTC, colin.corkerton wrote:

Some planned maintenance of the Met Office's DataPoint system is scheduled for Wednesday 7 December between 1000 and 1200 UTC.

DataPoint should continue to be available during this time, but data may not update as normal. If you do experience any problems after this time please let us know as soon as possible by contacting enqu...@metoffice.gov.uk including DataPoint in the subject line.

Met Office change CRQ168546 covers this work.

--
You received this message because you are subscribed to a topic in the Google Groups "Met Office DataPoint" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/metoffice-datapoint/5PSv-48Gt-k/unsubscribe.

To unsubscribe from this group and all its topics, send an email to metoffice-datapoint+unsubscribe...@googlegroups.com.

To post to this group, send email to metoffice-datapoint@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Jeremy Holmes]

Hi all. I still have the issue. 22:18 on 9th.

I'm using the JSON format and the DV component returns without the Param object

{"SiteRep":{"Wx":{"Param":[{"name":"F","units":"C","$":"Feels Like Temperature"},{"name":"G","units":"mph","$":"Wind Gust"},{"name":"H","units":"%","$":"Screen Relative Humidity"},{"name":"T","units":"C","$":"Temperature"},{"name":"V","units":"","$":"Visibility"},{"name":"D","units":"compass","$":"Wind Direction"},{"name":"S","units":"mph","$":"Wind Speed"},{"name":"U","units":"","$":"Max UV Index"},{"name":"W","units":"","$":"Weather Type"},{"name":"Pp","units":"%","$":"Precipitation Probability"}]},"DV":{"dataDate":"2016-12-09T18:00:00Z","type":"Forecast"}}}

Shout if you need more. Here's the get request (redacted slightly of course :)

‌http://datapoint.metoffice.gov.uk/public/data/val/wxfcs/all/json/351448?res=3hourly&key=MickeyMouse...

What is odd is that it works "sometimes" Was testing this afternoon and it was fine.

On Friday, 9 December 2016 14:15:36 UTC, Tim H wrote:

Hi Colin,

It looks like thinks have settled down now.

Our last issue was at 12:57 and that was just one request failure whereas before we getting lots failures.

Thank you for the resolution.

I hope you have a great weekend.

Cheers,

Tim

On Fri, Dec 9, 2016 at 11:00 AM, Colin Jones <colins...@gmail.com> wrote:

Hi Colin, seems fine now thanks :-)

Kind Regards

Colin Jones

Sent from my Nexus 5x phone

On 9 Dec 2016 08:31, "colin.corkerton" <colin.c...@metoffice.gov.uk> wrote:

Hi all,

Are you still experiencing any problems with missing data? This morning (Friday 9th) I have tried the various site ids mentioned below with my own API key and in each case the latest data is being returned.

Regards,

Colin

On Wednesday, December 7, 2016 at 9:14:26 AM UTC, colin.corkerton wrote:

Some planned maintenance of the Met Office's DataPoint system is scheduled for Wednesday 7 December between 1000 and 1200 UTC.

DataPoint should continue to be available during this time, but data may not update as normal. If you do experience any problems after this time please let us know as soon as possible by contacting enqu...@metoffice.gov.uk including DataPoint in the subject line.

Met Office change CRQ168546 covers this work.

--
You received this message because you are subscribed to a topic in the Google Groups "Met Office DataPoint" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/metoffice-datapoint/5PSv-48Gt-k/unsubscribe.

To unsubscribe from this group and all its topics, send an email to metoffice-datapoint+unsub...@googlegroups.com.

To post to this group, send email to metoffice...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "Met Office DataPoint" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/metoffice-datapoint/5PSv-48Gt-k/unsubscribe.
To unsubscribe from this group and all its topics, send an email to metoffice-datapoint+unsub...@googlegroups.com.

To post to this group, send email to metoffice...@googlegroups.com.

[colinsjonesuk]

It seems to have failed again.

Same thing, the tags are defined but the forecast data is missing from the xml.

<SiteRep><Wx><Param name="F" units="C">Feels Like Temperature</Param><Param name="G" units="mph">Wind Gust</Param><Param name="H" units="%">Screen Relative Humidity</Param><Param name="T" units="C">Temperature</Param><Param name="V" units="">Visibility</Param><Param name="D" units="compass">Wind Direction</Param><Param name="S" units="mph">Wind Speed</Param><Param name="U" units="">Max UV Index</Param><Param name="W" units="">Weather Type</Param><Param name="Pp" units="%">Precipitation Probability</Param></Wx><DV dataDate="2016-12-10T15:00:00Z" type="Forecast" />** MISSING SECTON **</SiteRep>

On Friday, 9 December 2016 14:15:36 UTC, Tim H wrote:

Hi Colin,

It looks like thinks have settled down now.

Our last issue was at 12:57 and that was just one request failure whereas before we getting lots failures.

Thank you for the resolution.

I hope you have a great weekend.

Cheers,

Tim

On Fri, Dec 9, 2016 at 11:00 AM, Colin Jones <colins...@gmail.com> wrote:

Hi Colin, seems fine now thanks :-)

Kind Regards

Colin Jones

Sent from my Nexus 5x phone

On 9 Dec 2016 08:31, "colin.corkerton" <colin.c...@metoffice.gov.uk> wrote:

Hi all,

Are you still experiencing any problems with missing data? This morning (Friday 9th) I have tried the various site ids mentioned below with my own API key and in each case the latest data is being returned.

Regards,

Colin

On Wednesday, December 7, 2016 at 9:14:26 AM UTC, colin.corkerton wrote:

Some planned maintenance of the Met Office's DataPoint system is scheduled for Wednesday 7 December between 1000 and 1200 UTC.

DataPoint should continue to be available during this time, but data may not update as normal. If you do experience any problems after this time please let us know as soon as possible by contacting enqu...@metoffice.gov.uk including DataPoint in the subject line.

Met Office change CRQ168546 covers this work.

--
You received this message because you are subscribed to a topic in the Google Groups "Met Office DataPoint" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/metoffice-datapoint/5PSv-48Gt-k/unsubscribe.

To unsubscribe from this group and all its topics, send an email to metoffice-datapoint+unsub...@googlegroups.com.

To post to this group, send email to metoffice...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "Met Office DataPoint" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/metoffice-datapoint/5PSv-48Gt-k/unsubscribe.
To unsubscribe from this group and all its topics, send an email to metoffice-datapoint+unsub...@googlegroups.com.

To post to this group, send email to metoffice...@googlegroups.com.

[David Barton]

Just to add, I'm also seeing missing data.  On Friday and Saturday the json daily forecast for Uppermill (354028) was empty. I switched to the xml feed which initially worked but is now showing empty data too.

On Wednesday, December 7, 2016 at 9:14:26 AM UTC, colin.corkerton wrote:

[colinsjonesuk]

Gone again! Looks like the same problem.

On Wednesday, 7 December 2016 09:14:26 UTC, colin.corkerton wrote:

[colin.corkerton]

Hi all,

This issue is being investigated by our technical support. The Met Office reference is INC597941.

Regards,

Colin

On Wednesday, December 7, 2016 at 9:14:26 AM UTC, colin.corkerton wrote:

[Jeremy Holmes]

FWIW my experience has it as a time-based issue. It seems to happen somewhere around mid-afternoon and then extends into the evening. Currently not working at 1800 today (Monday 12th) but so far I've round that it comes back to life later on in the evening.

[colin.corkerton]

Hi all,

A problem affecting the updating of the capabilities files was found on Tuesday 13th. This was fixed and we believe the issue of missing data has now been resolved. However if you are still experiencing any issues with missing data please contact  enqu...@metoffice.gov.uk including DataPoint in the subject line.

Colin

On Wednesday, December 7, 2016 at 9:14:26 AM UTC, colin.corkerton wrote: