Availability of Supplemented Subway GTFS Feed

[Raschke, Kurt]

Dear Developer: 

 

In response to feedback from this community and our riders, MTA New York City Transit has developed a new, more frequently updated static GTFS feed for the subway which accounts for most planned work and service diversions.  This feed will be updated at least daily, and contains a seven-day rolling lookahead which will be populated with enhanced schedule information. Outside of the seven-day lookahead period, the new feed will contain the same schedule data as the existing Subway GTFS feed. 

 

The enhanced schedule information is based on internal “supplement” schedules which are used for operational purposes.  However, not all service changes are reflected in these supplements, and consequently may not be reflected in this new GTFS feed. 

 

This feed integrates various internal systems and data sources, and we will continue to evolve and improve it in the coming months. 

 

The feed can be retrieved from the following location: 

 

http://web.mta.info/developers/files/google_transit_supplemented.zip

 

Kurt Raschke

NYCT | Subways | Digital Initiatives

 

[Michael B. Justice]

So is the intended use that developers continuously download the supplemental file for daily use?  So if I download the file today, the trips and stop times and calendars are good based on the data in calendar/calendar_date/trips/stop_times, and that the supplemental file I download tomorrow would contain the correct information for the 7 day period beginning tomorrow?

MJ

--
You received this message because you are subscribed to the Google Groups "mtadeveloperresources" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mtadeveloperreso...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Raschke, Kurt]

Michael,

 

Yes, that’s the general intention.  Every day, the feed will contain a seven-day lookahead, so in principle a developer can download that and use it for the next seven days, then refresh the feed to get the next seven days – but we recommend updating more frequently (ideally daily) to get the latest updates and have valid data for the next seven days.

 

Kurt Raschke

NYCT | Subways | Digital Initiatives

 

[Michael B. Justice]

Thank you for being clear. I haven't downloaded the file yet, but can I presume that the supplemental file includes the 7-day changes and the balance of the calendar for whatever the current timetable addresses? 

MJ

[Raschke, Kurt]

Michael,

 

Your understanding is correct.  Outside of the seven-day window, the new supplemented feed will contain the same information as the existing static GTFS feed.

[lo...@thetransitapp.com]

Kurt,

Let's call the new daily supplemented Subway GTFS "enhanced GTFS" and the regular existing Subway GTFS "regular GTFS".

I am currently using these URLs for each GTFS:

• Enhanced GTFS:     http://web.mta.info/developers/files/google_transit_supplemented.zip

• Regular GTFS:         http://web.mta.info/developers/data/nyct/subway/google_transit.zip

I would like to begin using the enhanced GTFS, but:

=> The enhanced GTFS does not have any data for SIR, from June 21st to 24th.

=> The regular GTFS does have data for SIR, but does not have data for any other lines from June 21st to 24th.

So, should I be using the enhanced GTFS for all lines except the SIR and use the regular GTFS just for the SIR? Or is this a bug, and SIR will soon be in the enhanced?

Thanks in advance,

Louis Van Craen

The Transit App

Backend Software Developer

[da_s...@apple.com]

Hi,

We were reviewing the supplemented/enhanced feed for this weekend, and noticed that the 2 and 5 train service changes seem to have been mixed up this weekend:

2 Train Service Alert:

- 2 service operates via the 5 to/from Dyre Av, then between E 180 St and Chambers St, and via the 1 to/from Rector St.

Observed in feed:

The 2 train is running from Flatbush Av to 241 St. 

The 2 train does not run via the 1 to/from Rector St.

The 2 train is running in Brooklyn, but should be replaced the 5 train.

The 2 train is running over the 5 line in Manhattan

5 Train Service Alert:

- 5 service operates between Flatbush Av and E 180 St, and via the 2 to/from 241 St.

Observed in feed:

The 5 train runs between Eastchester - Dyre Av and Rector St on 6/25

The 5 train does not run in Brooklyn 

The 5 train is running over the 2 line in Manhattan

Thanks,

Doug

[Raschke, Kurt]

Louis,

 

There are two issues here which combined to result in the condition you observed:

 

1.       The “regular” GTFS reflects the service/schedule changes which will take effect on June 25 – this is unrelated to the launch of the supplemented/enhanced GTFS.

2.       The “enhanced” GTFS is based off of a merged schedule which includes the current schedule up to June 24 as well as the new schedule from June 25 onwards; however, due to a bug it did not include data for SIR from the current schedule (that is, prior to June 25).  This has been corrected.

 

Kurt Raschke

NYCT | Subways | Digital Initiatives

 

--

[Raschke, Kurt]

Doug,

 

Your observations are correct – this is an artifact of how these trips are planned and crewed internally.  During this weekend service change, 5 trains are internally scheduled and operated as 2 trains, and vice versa.  However, they are displaying the “correct” signage, so while a train may be operated by a 2 crew, it will appear outwardly to be a 5.

 

We’re working to address this in the data so that the GTFS route for these trains will reflect the signage they present to riders, rather than the route on which the trips are internally scheduled.

 

Kurt Raschke

NYCT | Subways | Digital Initiatives

 

From: mtadevelop...@googlegroups.com [mailto:mtadevelop...@googlegroups.com] On Behalf Of da_s...@apple.com
Sent: Thursday, June 22, 2017 13:02
To: mtadeveloperresources <mtadevelop...@googlegroups.com>
Subject: [MTAdev] Re: Availability of Supplemented Subway GTFS Feed

 

Hi,

 

We were reviewing the supplemented/enhanced feed for this weekend, and noticed that the 2 and 5 train service changes seem to have been mixed up this weekend:

 

2 Train Service Alert:

- 2 service operates via the 5 to/from Dyre Av, then between E 180 St and Chambers St, and via the 1 to/from Rector St.

 

Observed in feed:

The 2 train is running from Flatbush Av to 241 St. 

The 2 train does not run via the 1 to/from Rector St.

The 2 train is running in Brooklyn, but should be replaced the 5 train.

The 2 train is running over the 5 line in Manhattan

 

 

5 Train Service Alert:

- 5 service operates between Flatbush Av and E 180 St, and via the 2 to/from 241 St.

 

Observed in feed:

The 5 train runs between Eastchester - Dyre Av and Rector St on 6/25

The 5 train does not run in Brooklyn 

The 5 train is running over the 2 line in Manhattan

 

Thanks,

Doug

On Monday, June 19, 2017 at 4:14:19 PM UTC-4, Kurt Raschke wrote:

Dear Developer: 

 

In response to feedback from this community and our riders, MTA New York City Transit has developed a new, more frequently updated static GTFS feed for the subway which accounts for most planned work and service diversions.  This feed will be updated at least daily, and contains a seven-day rolling lookahead which will be populated with enhanced schedule information. Outside of the seven-day lookahead period, the new feed will contain the same schedule data as the existing Subway GTFS feed. 

 

The enhanced schedule information is based on internal “supplement” schedules which are used for operational purposes.  However, not all service changes are reflected in these supplements, and consequently may not be reflected in this new GTFS feed. 

 

This feed integrates various internal systems and data sources, and we will continue to evolve and improve it in the coming months. 

 

The feed can be retrieved from the following location: 

 

http://web.mta.info/developers/files/google_transit_supplemented.zip

 

Kurt Raschke

NYCT | Subways | Digital Initiatives

 

--

[ja...@citymapper.com]

Hi

We recognised that in recent versions of the enhanced GTFS file some lines have significantly fewer trips than usual. No track works are announced on the affected lines.

Examples from today's schedules:

• 6 Train
• Regular GTFS: 447 trips
• Enhanced GTFS: 80 trips
• No planned disruptions: http://travel.mtanyct.info/serviceadvisory/routeStatusResult.aspx?tag=6&date=7/7/2017&time=&method=getstatus4
  
  
• N Train
• Regular GTFS: 267 trips
• Enhanced GTFS: 36 trips
• No planned disruptions: http://travel.mtanyct.info/serviceadvisory/routeStatusResult.aspx?tag=N&date=7/7/2017&time=&method=getstatus4

Is this drop in number of trips expected?

Thanks,

Jakob

[Raschke, Kurt]

Jakob,

 

Thanks for the report – we’re currently looking at some upstream data issues which are impacting the Supplemented GTFS production process.

 

Kurt Raschke

NYCT | Subways | Digital Initiatives

 

From: mtadevelop...@googlegroups.com [mailto:mtadevelop...@googlegroups.com] On Behalf Of ja...@citymapper.com
Sent: Friday, July 07, 2017 10:37
To: mtadeveloperresources <mtadevelop...@googlegroups.com>
Subject: [MTAdev] Re: Availability of Supplemented Subway GTFS Feed

 

Hi

--

[ja...@citymapper.com]

Hi Kurt

Would you have an update when a fixed version of the supplemented GTFS with the planned service changes will be available?

The version from this morning still has several issues. Among other things the 7, J and Z train are missing ~80% of the trips. No planned work announced on these lines.

Thanks for your update.

Jakob

To unsubscribe from this group and stop receiving emails from it, send an email to mtadeveloperresources+unsub...@googlegroups.com.

[Raschke, Kurt]

Jakob,

 

We are still working to resolve this issue internally – we will let the group know when we have a further update.

[jo...@citymapper.com]

Hi Kurt,

Are there still any known issues with this GTFS?

This weekend for example all of the F trains appear to be using the D line in Brooklyn instead of the usual route. But that doesn't seem to match up with any of the planned service changes. There are also some B trains stopping local in Brooklyn which seems unusual.

Thanks,

John

[Raschke, Kurt]

We have encountered some business process challenges that have had a greater impact on the accuracy of the Supplemented GTFS feed than anticipated. We are currently engaged with the relevant internal partners to address these processes to better serve this new feed. We expect the feed’s quality should improve iteratively in the coming months, and we’re committed to addressing these challenges to make it a useful product for data consumers. Thanks for your patience.

 

Kurt Raschke

NYCT | Subways

 

From: mtadevelop...@googlegroups.com [mailto:mtadevelop...@googlegroups.com] On Behalf Of jo...@citymapper.com
Sent: Wednesday, August 30, 2017 17:39
To: mtadeveloperresources <mtadevelop...@googlegroups.com>
Subject: [MTAdev] Re: Availability of Supplemented Subway GTFS Feed

 

Hi Kurt,

 

Are there still any known issues with this GTFS feed?

This weekend it has F trains using the D line in Brooklyn, and there doesn't seem to be a matching planned service disruption. The B also has some local stops in Brooklyn which don't appear to match either. Are these inclusions intended?

Thanks,

John

 

--
You received this message because you are subscribed to the Google Groups "mtadeveloperresources" group.

To unsubscribe from this group and stop receiving emails from it, send an email to mtadeveloperreso...@googlegroups.com.

[Daniel Ramteke]

Thanks for the response, Kurt. Good to know. Excited for this feed!

Daniel

https://underway.nyc
Real time subway arrivals for New York City.
For iPhone & iPad: https://itunes.apple.com/us/app/underway-real-time-subway/id1118548566?ls=1&mt=8

[webm...@rideschedules.com]

Why isn't the supplemental feed listed on the mta.info data downloads page?

[jo...@citymapper.com]

We've noticed that since the holidays this GTFS no longer includes the majority of planned service changes. Will they be making a return anytime soon?