Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

git transmat should parallelize more (and network less) #9

Open
warpfork opened this issue Jan 4, 2020 · 0 comments
Open

git transmat should parallelize more (and network less) #9

warpfork opened this issue Jan 4, 2020 · 0 comments

Comments

@warpfork
Copy link
Member

warpfork commented Jan 4, 2020

The git transmat should do a lot more work in parallel.

There's probably some very low-hanging fruit here.

Particularly, for submodules to be fetched in parallel once the main repo checkout is available should be possible. (It should even be possible in parallel with the actual checkout -- the submodules can be read from the git data, then submodule fetches launched, before/in-parallel to the actual file content checkouts.)

Sidequest note: I have a sneaking suspicion there's also a bug that causes the git warehouse "open" functions to dial more than necessary (particularly, when the desired hash is already available in the repo)... and this may (or may not, idk) show up on the path and be easy to fix while handling the other parallelization.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant