Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove vp nearest neighbor intermediate output #1319

Merged
merged 7 commits into from
Dec 9, 2024

Conversation

tiffanychu90
Copy link
Member

@tiffanychu90 tiffanychu90 commented Dec 9, 2024

gtfs_funnel / segment_speeds

  • drop an intermediate output for vp.
  • in vp_condenser, vehicle positions are strung together into linestrings so we can use all those coordinates in an array.
    • since stops move in certain directions, a second output is created to show all the allowable options for stops (factoring in direction). ex: northbound traveling stops cannot select from southbound vp.
    • refactor this to handle it all together. the array can first filter away opposite directions and then select the nearest 10 vp to the stop.
  • dropping this intermediate step adds a little time to the earlier step (instead of 7 + 12 min = 19 min, now it's roughly 15 min combined)
  • remove entry in gtfs_analytics_data.yml and see how Dec 2024 monthly publishing goes
  • bump gtfs_segments package up from 0.1.0 to 2.1.7, which will soon make its way to Hub image.
    • update cut_stop_segments.py and add dummy arrival time to get dask.map_partitions to work
  • Epic - GTFS analytics pipeline performance improvements #1315

This comment was marked as duplicate.

1 similar comment
Copy link

github-actions bot commented Dec 9, 2024

nbviewer URLs for impacted notebooks:

This comment was marked as duplicate.

1 similar comment
Copy link

github-actions bot commented Dec 9, 2024

nbviewer URLs for impacted notebooks:

Copy link

github-actions bot commented Dec 9, 2024

nbviewer URLs for impacted notebooks:

@tiffanychu90 tiffanychu90 merged commit 323bbed into main Dec 9, 2024
2 checks passed
@tiffanychu90 tiffanychu90 deleted the remove-vp-nn-output branch December 9, 2024 19:43
@tiffanychu90 tiffanychu90 changed the title Remove vp nn output Remove vp nearest neighbor intermediate output Dec 9, 2024
Copy link

github-actions bot commented Dec 9, 2024

nbviewer URLs for impacted notebooks:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant