Fix traversal of dirs containing troublesome softlinks #1551

Job	Run time
CI on centos-stream-fsf-latest	8m 36s
CI on debian-stable	5m 36s
CI on fedora-latest	6m 11s
CI on ubuntu-lts	6m 1s
CI on arch-rolling	5m 33s
	31m 57s

Provide feedback