Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move/run away from tokyo cabinet #128

Closed
domsj opened this issue Aug 30, 2016 · 3 comments
Closed

Move/run away from tokyo cabinet #128

domsj opened this issue Aug 30, 2016 · 3 comments

Comments

@domsj
Copy link

domsj commented Aug 30, 2016

See #110 and #122 for the motivation. Ops team sees this too much, and tokyo cabinet is unmaintained.
Currently it's an accident waiting to happen.
In the short term we still want to implement #122 so ops can monitor this more closely.

Possible replacement candidates:

  • rocksdb
    • could remove the need for head.db + collapsing could become cheap
    • db consists of multiple files, which would require some changes for catchup to handle this
  • lmdb
    • ocaml binding doesn't expose iterators / range queries
    • rest of the flow/code would remain the same

For both of these it should be possible to provide a way forward for existing clusters.
Either:

  • allow catchup of head.db in a database agnostic fashion (send key value pairs over the wire)
    • for each node: wipe it, let it catchup from the others
  • provide a method to export an old (head) db to the new database format
    • for each node: stop node, transform head db, remove main db, start node
@wimpers
Copy link

wimpers commented Aug 31, 2016

@domsj any time estimate?

@domsj
Copy link
Author

domsj commented Aug 31, 2016

2 weeks

@toolslive
Copy link
Member

This was done in the Enterprise Edition.

@wimpers wimpers modified the milestones: Roadmap, M Aug 16, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants