generate-france: Use stable urls

[jbruechert]

No description provided.

[kalon33]

It seems to be working, only 4 errors in the test run (missing agency.txt, all from the same feed producer)

[jbruechert]

Will add these to the exclusion list then in the evening

[jbruechert]

Unfortunately these feeds are fairly important, but return something like

donnees;format;download
Horaires des trains Transilien NeTEx;NeTEx;https://eu.ftp.opendatasoft.com/sncf/gtfs/transilien-netexfr.zip
Horaires des trains Transilien GTFS;GTFS;https://eu.ftp.opendatasoft.com/sncf/gtfs/transilien-gtfs.zip

Maybe the logic for picking the right resource needs some improvement.

EDIT we are already picking the right resource, but "url" and "original_url" don't return the same.

[kalon33]

Unfortunately these feeds are fairly important, but return something like

donnees;format;download
Horaires des trains Transilien NeTEx;NeTEx;https://eu.ftp.opendatasoft.com/sncf/gtfs/transilien-netexfr.zip
Horaires des trains Transilien GTFS;GTFS;https://eu.ftp.opendatasoft.com/sncf/gtfs/transilien-gtfs.zip

Maybe the logic for picking the right resource needs some improvement.

EDIT we are already picking the right resource, but "url" and "original_url" don't return the same.

Yep indeed, SNCF feeds are relevant for most trains in France...

I still don't see some data in transitous (Cap Cotentin related data notably) do you know why?

[laem]

Hi, feel free to read this very similar (deno) script https://github.com/laem/gtfs/blob/master/buildConfig.ts

I had the same problem with some URLs returning index files instead of GTFS files...

This comment : https://github.com/laem/gtfs/blob/master/buildConfig.ts#L157

I've informed the team about this.

[jbruechert]

Thanks, it would be best if it was resolved upstream. Until then, regenerating the file often enough helps partially.