Empty fields in Movement feed for planned_timestamp and actual_timestamp

[Neil Walkinshaw]

Hi,

I have noticed that most cases, the planned_timestamp and actual_timestamp fields are empty in the train movement feed. Is there a reason for this? Are these timestamps restricted to particular locations? Is it possible to determine these?

Thanks in advance for any pointers,

Neil Walkinshaw 

[Phil Wieland]

Are you sure?  All my records have an actual_timestamp.  plannned and gbtt may be missing, e.g. if train is off-route.

Phil

[Peter Hicks]

Some example messages would be useful so we can see what's happening.

Peter

--
You received this message because you are subscribed to the Google Groups "A gathering place for the Open Rail Data community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to openraildata-t...@googlegroups.com.
To post to this group, send email to openrail...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Neil Walkinshaw]

Hi all,

Thanks a lot for the prompt responses.

Phil has solved my problem. They all have an actual_timestamp, but none of them have a planned_timestamp. All of them are off-route, which explains it.

Given that this occurs with such a huge frequency, am I right to assume that off-route can include, for example, trains returning to the depot etc.?

Thanks a lot, and all the best,

Neil

{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308224000","source_system_id":"TRUST"},"body":{"event_type":"ARRIVAL","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311840000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"88","train_terminated":"false","train_id":"533J05MR22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"21788001","toc_id":"88","loc_stanox":"54297","auto_expected":"","direction_ind":"","route":"","planned_event_type":"ARRIVAL","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308225000","source_system_id":"TRUST"},"body":{"event_type":"DEPARTURE","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311780000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"80","train_terminated":"false","train_id":"882R50MS22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"24605000","toc_id":"80","loc_stanox":"88409","auto_expected":"","direction_ind":"","route":"","planned_event_type":"DEPARTURE","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308243000","source_system_id":"TRUST"},"body":{"event_type":"DEPARTURE","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311780000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"84","train_terminated":"false","train_id":"871L49MS22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"24623104","toc_id":"84","loc_stanox":"87214","auto_expected":"","direction_ind":"","route":"","planned_event_type":"DEPARTURE","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308309000","source_system_id":"TRUST"},"body":{"event_type":"ARRIVAL","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311960000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"21","train_terminated":"false","train_id":"521K66MS22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"25943001","toc_id":"21","loc_stanox":"50401","auto_expected":"","direction_ind":"","route":"","planned_event_type":"ARRIVAL","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308325000","source_system_id":"TRUST"},"body":{"event_type":"ARRIVAL","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311960000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"25","train_terminated":"false","train_id":"731Z402S22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"25516005","toc_id":"25","loc_stanox":"73770","auto_expected":"","direction_ind":"","route":"","planned_event_type":"ARRIVAL","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308329000","source_system_id":"TRUST"},"body":{"event_type":"ARRIVAL","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311900000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"84","train_terminated":"false","train_id":"871W73MS22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"24620204","toc_id":"84","loc_stanox":"86005","auto_expected":"","direction_ind":"","route":"","planned_event_type":"ARRIVAL","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308333000","source_system_id":"TRUST"},"body":{"event_type":"DEPARTURE","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311900000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"21","train_terminated":"false","train_id":"521K66MS22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"25943001","toc_id":"21","loc_stanox":"50401","auto_expected":"","direction_ind":"","route":"","planned_event_type":"DEPARTURE","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308343000","source_system_id":"TRUST"},"body":{"event_type":"DEPARTURE","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311900000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"61","train_terminated":"false","train_id":"541D20MR22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"21702001","toc_id":"61","loc_stanox":"45013","auto_expected":"","direction_ind":"","route":"","planned_event_type":"DEPARTURE","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308344000","source_system_id":"TRUST"},"body":{"event_type":"ARRIVAL","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311900000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"82","train_terminated":"false","train_id":"872L44MS22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"24610000","toc_id":"82","loc_stanox":"87203","auto_expected":"","direction_ind":"","route":"","planned_event_type":"ARRIVAL","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308350000","source_system_id":"TRUST"},"body":{"event_type":"ARRIVAL","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311900000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"82","train_terminated":"false","train_id":"871A27MQ22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"24663004","toc_id":"82","loc_stanox":"87203","auto_expected":"","direction_ind":"","route":"","planned_event_type":"ARRIVAL","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308354000","source_system_id":"TRUST"},"body":{"event_type":"DEPARTURE","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311900000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"84","train_terminated":"false","train_id":"871W73MS22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"24620204","toc_id":"84","loc_stanox":"86005","auto_expected":"","direction_ind":"","route":"","planned_event_type":"DEPARTURE","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308355000","source_system_id":"TRUST"},"body":{"event_type":"DEPARTURE","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311900000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"25","train_terminated":"false","train_id":"731Z402S22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"25516005","toc_id":"25","loc_stanox":"73770","auto_expected":"","direction_ind":"","route":"","planned_event_type":"DEPARTURE","next_report_stanox":"","line_ind":""}}
{"header":{"msg_type":"0003","source_dev_id":"","user_id":"","original_data_source":"SMART","msg_queue_timestamp":"1432308356000","source_system_id":"TRUST"},"body":{"event_type":"DEPARTURE","gbtt_timestamp":"","original_loc_stanox":"","planned_timestamp":"","timetable_variation":"0","original_loc_timestamp":"","current_train_id":"","delay_monitoring_point":"false","next_report_run_time":"","reporting_stanox":"","actual_timestamp":"1432311960000","correction_ind":"false","event_source":"AUTOMATIC","train_file_address":null,"platform":"","division_code":"80","train_terminated":"false","train_id":"881H02MS22","offroute_ind":"true","variation_status":"OFF ROUTE","train_service_code":"24602000","toc_id":"80","loc_stanox":"88409","auto_expected":"","direction_ind":"","route":"","planned_event_type":"DEPARTURE","next_report_stanox":"","line_ind":""}}

You received this message because you are subscribed to a topic in the Google Groups "A gathering place for the Open Rail Data community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/openraildata-talk/MPQkfIIs8so/unsubscribe.
To unsubscribe from this group and all its topics, send an email to openraildata-t...@googlegroups.com.

[Peter Hicks]

Hi Neil

‘OFF ROUTE’ is when a train reports at a location not in the schedule.  These can happen ‘on route’, e.g. at Vauxhall when a train reports there but Vauxhall isn’t in the schedule for the train, and they can also happen legitimately ‘off route’, e.g. a train is diverted via Northampton when it’s booked via the ‘other route’.

Think of it more as “a report that doesn’t have a corresponding entry in the schedule”.

Peter

[Phil Wieland]

Not exactly, as a train returning to depot would normally have an ECS schedule for that move.

Off-route is for trains which have been diverted from their planned route so that the system does not have a planned_timestamp for the location the report has come from.

Or, for a train on the correct route but the report location has been omitted from the planned schedule.

You need to examine the movement reports for the train and compare them with the schedule to see what's going on in each case.

Cheers,

Phil

[Dave Butland]

I see a lot of "OFF-ROUTE's for trains coming into Paddington. I think it just depends on what line the train is on in this case. You certainly need to be able to cope with null planned_timestamps anyway as they occur all the time.