removeReferencesToVendoredSourcesHook: dedup references (#745)

Debug builds might have a ton of references to sources, and `sed` does
not like it when we feed it a massive amount of duplicates

CHANGELOG.md

@@ -6,6 +6,10 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
 
 ## Unreleased
 
+### Fixed
+* `removeReferencesToVendoredSources` now deduplicates any found references to
+  avoid pathological memory usage before removing them.
+
 ## [0.19.3] - 2024-11-18
 A republish of 0.19.2 which was incorrectly tagged.
 

lib/setupHooks/removeReferencesToVendoredSourcesHook.sh

@@ -23,6 +23,7 @@ removeReferencesToVendoredSources() {
             xargs -I DIR find -H DIR -type l -exec readlink '{}' \;
         ) |
           grep --only-matching '@storeDir@/[a-z0-9]\{32\}' |
+          sort -u |
           while read crateSource; do
             echo -n '\|'"${crateSource#@storeDir@/}";
           done || true # Handle if vendoredDir doesn't point to the store