Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create CMS Requests for node batches #7

Open
artgromov opened this issue May 29, 2024 · 0 comments
Open

Create CMS Requests for node batches #7

artgromov opened this issue May 29, 2024 · 0 comments

Comments

@artgromov
Copy link
Member

To reduce load on CMS we should create CMS Requests with no more than N nodes in each batch.

N could easily be no more than 1000.

New workflow could look like this:

  1. get all nodes to restart, random shuffle them
  2. get N nodes from all nodes, put it in CMS Request with partial_permissions_allowed=true
  3. restart nodes while getting permissions from CMS
  4. if some nodes in current batch cannot be restarted, put them in separate blocked nodes batch (like DLQ in messaging)
  5. get next batch, repeat 3 and 4
  6. after all batches finished, get blocked nodes batch and split them in batches by N, trying to finish restart (here availability mode changes could be applied to eventually finish restart)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant