How much storage is needed?

[jwmurray]

How much storage are people typically allocating or using with Athens? I would be using it for air-gap development offline.

Thank you

John

[arschles]

Hi @jwmurray, that depends on how many dependencies you need to store. Athens runs go mod download and stores the results (go.mod file, vX.Y.X.info file, and the vX.Y.Z.zip file), so you can calculate exactly what it will store for an individual module by running that on your machine and adding up those file sizes.

[jwmurray]

So, if I want to use Athens as a server for offline development, I have to know ahead of time the modules I will want to archive. Does Athens provide a means of recording missing modules to be retrieved? Suppose I attempt a build in my airgap network and find that I am missing modulex.version6. I then need to go to my network server, issue the go.mod file modulex.version6 command and then create a DVD and transfer that to my airgap directory/Athens server. Is that easy for the two Athens boxes to figure out which files are needed for updates? Thank you! john

…

On Thu, Nov 19, 2020 at 1:38 PM Aaron Schlesinger ***@***.***> wrote: Hi @jwmurray <https://github.com/jwmurray>, that depends on how many dependencies you need to store. Athens runs go mod download and stores the results (go.mod file, vX.Y.X.info file, and the vX.Y.Z.zip file), so you can calculate exactly what it will store for an individual module by running that on your machine and adding up those file sizes. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#1678 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAB3HTOZJJBASFCIACEQZBLSQV63XANCNFSM4TY2W6GQ> .

-- John Murray [email protected] text: 801-628-0543

[arschles]

Athens doesn't formally record what modules it doesn't have, although you could parse the logs to figure it out. It's possible to load Athens with dependencies without requiring network access. We have two resources for doing that. First, here's a guide on how to pre-fill disk storage. As the title says, it only works with disk-based storage. If you're using other storage backends, we don't have an official solution yet, but there is a work in progress PR published that builds a CLI to support others: #1609.