Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IPFS backups of videos #265

Open
tonyhb opened this issue Jun 5, 2020 · 4 comments
Open

IPFS backups of videos #265

tonyhb opened this issue Jun 5, 2020 · 4 comments
Labels
Engineering Changes our tools and data pipeline

Comments

@tonyhb
Copy link

tonyhb commented Jun 5, 2020

Wondering if we should back up videos on IPFS for redundant storage and a little safer peace of mind, given where things are at.

Let me know, and maybe we can work on a CI system that uses youtube-dl to auto-push to IPFS and generate a PR with the updated links.

@zbronstein
Copy link

I would be interested in this - I have plenty of storage space and would happily contribute many GBs to storing this information in case it gets deleted from wherever it's hosted now (I've seen a bunch of videos be removed from Twitter already). With that said, I am no expert in automating this kind of thing. Please let me know how I can helpful here - will try to figure it out in the mean time.

@san4d
Copy link

san4d commented Jun 5, 2020

I'd like to contribute to a distributed backup system. OrbitDB looks like a nice IPFS wrapper.

@2020PB
Copy link
Collaborator

2020PB commented Jun 5, 2020

#222 Just merged this

@bonedaddy
Copy link
Collaborator

bonedaddy commented Jun 5, 2020

I'll spin up an "IPFS Follow Cluster" for this, so interested parties can mirror the data. If you're interested in reading about this look at https://cluster.ipfs.io/documentation/collaborative/

preliminary ipfs cluster anyone can join to mirror data:

$> ipfs-cluster-follow 2020pb-dataset run --init 2020pb.temporal.cloud

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Engineering Changes our tools and data pipeline
Projects
None yet
Development

No branches or pull requests

5 participants