Deploy Managed Postgres on DigitalOcean

[nelsonic]

In light of Fly.io losing all our data for both Auth dwyl/auth#325 and the MVP dwyl/mvp#449 (comment)
I've decided we won't be using their platform anymore. EVER!! 😡

Instead, going to use https://www.digitalocean.com/products/managed-databases-postgresql
Because we can have an unlimited databases (with small amounts of data) in the same cluster:
https://www.digitalocean.com/community/questions/how-many-databases-can-i-create-for-15

Pricing: https://www.digitalocean.com/pricing/managed-databases at the time of writing $15/month

Todo

• Record Screen while doing all the setup!
• Setup the DB!
• Create a Test DB
• Add some data
• Retrieve the data
• Explore the point-in-time recovery

Next

• Deploying a Phoenix Application to Digital Ocean: https://www.youtube.com/watch?v=Dw7RPqSIv-0
  • https://github.com/or-equals/liveview_mastery/pull/11/files

[nelsonic]

For the record: before embarking on this, we did a quick check of the Fly.io docs:
https://fly.io/docs/postgres/advanced-guides/high-availability-and-global-replication
To confirm they haven't changed their stance on having managed Postgres ...
Sadly, they haven't changed their stance on managed service:
https://fly.io/docs/postgres/getting-started/what-you-should-know/

It's still very much a "manage you own with our tools" ...
And as we've experienced, that's not fun when the machine crashes.

Their approach to high availability is still manual:
https://fly.io/docs/postgres/advanced-guides/high-availability-and-global-replication/

They are open about this approach not being good for write-heavy apps and those with long-lived connections:
https://fly.io/docs/postgres/advanced-guides/high-availability-and-global-replication/#this-is-wrong-for-some-apps

Doc snapshot: eb45cbf/postgres/advanced-guides/high-availability-and-global-replication.html.markerb

So with that, I feel like I'm left with no choice but to switch (the DB) to DigitalOcean Managed Postgres.

[nelsonic]

The "problem" with DigitalOcean Managed Postgres: https://www.digitalocean.com/pricing/managed-databases#postgresql is that the cheapest instance $15/month is a total bait-and-switch!

The moment you want multiple instances for failover, they bump the instance from 1GB RAM to 2GB RAM and 10GB SSD to 30GB SSD i.e. not even "high availability", just a backup instance, quadruples the price!!

We only care about this while developing an App because it's $60/month x 12 month = $720/year ... 💸

And if/when you need to scale (vertically) the max is: 256 GiB RAM and 15TB SSD for $16,494/month:

Nobody is going to spend this much without having the revenue to cover it. 💰
Cough-cough except every "AI" company spending 100x this on training models with no path to profitability ... 😜
That's "VC Money" it's not real. Anyway ... 🤐

[nelsonic]

PR in-progress: #92 🧑‍💻 ⏳

[nelsonic]

GOTO: #93 ⏳

[nelsonic]

Given that connecting from Fly.io to DigitalOcean was a dead-end #93 (comment) we need to decide if we are going to use DigitalOcean for our Apps or if we should consider something more self-managed e.g: Hetzner #97 💭

The "hard" part is the Postgres, we need High Availability (continuous backups) and ideally fast/cheap storage.
DigitalOcean is silly expensive as noted above #90 (comment) the price accelerates rather than passing economies of scale back to the customer. 📈 💸
Obviously reaching the sort of scale where paying for serious Postgres resources are champagne problems.
but I still find it absurd to pay $16k/month for something that would cost ~€2k on Hetzner! 🤯 💰 🔥
https://www.hetzner.com/dedicated-rootserver

This is still an expensive machine! But there is simply no comparison! it's 1/8 the price!!
Sooooo ... this is what I'm thinking: dwyl/mvp#488 (comment)