Examine if using google s3 storage is faster than minio locally

[C-Loftus]

For our use case we aren't particularly concerned with the uptime or distributed properties of a hosted s3 storage provider.

We are recrawling in an immutable way and none of our operations are stateful. Given the fact that any remote s3 is going to introduce latency it might not actually be useful to use it. It may be faster to just run with minio.

It could be interesting to time the crawl with minio vs a remote s3 provider and see if there is a difference.