Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOC] Segment Replication - GA release #2255

Closed
1 of 4 tasks
hdhalter opened this issue Dec 19, 2022 · 4 comments · Fixed by #3461
Closed
1 of 4 tasks

[DOC] Segment Replication - GA release #2255

hdhalter opened this issue Dec 19, 2022 · 4 comments · Fixed by #3461
Assignees
Labels
Closed - Complete Issue: Work is done and associated PRs closed Sev3 Medium priority. Content that's missing, driven by dev, PM or the community. v2.7.0

Comments

@hdhalter
Copy link
Contributor

hdhalter commented Dec 19, 2022

What do you want to do?

  • Request a change to existing documentation
  • Add new documentation
  • Report a technical problem with the documentation
  • Other

Tell us about your request. Provide a summary of the request and all versions that are affected.
Currently an experimental feature, Segment Replication will be generally available in the 2.7 release.

For the GA release: Propose a new shard replication strategy (segment replication) and outline its tradeoffs with the existing approach (document replication). In segment replication, we copy Lucene segment files from the primary shard to its replicas instead of having replicas re-execute the operation.

What other resources are available? Provide links to related issues, POCs, steps for testing, etc.
The SDM is Anas Alkous (@anasalkouz) and the SDE is Marc Handalian (@mch2).
Design proposal: opensearch-project/OpenSearch#2229

@hdhalter hdhalter added this to the v2.7 milestone Dec 19, 2022
@Naarcha-AWS Naarcha-AWS added 1 - Backlog Issue: The issue is unassigned or assigned but not started and removed untriaged labels Jan 3, 2023
@ariamarble ariamarble added Sev3 Medium priority. Content that's missing, driven by dev, PM or the community. and removed 1 - Backlog Issue: The issue is unassigned or assigned but not started labels Feb 27, 2023
@dreamer-89
Copy link
Member

As mentioned here, the segment replication uses recovery settings, thus available max_bytes_per_sec defaults (40 MB/s) is not reserved for recovery alone. This should be called out in documentation.

@ariamarble ariamarble added the release-notes PR: Include this PR in the automated release notes label Mar 15, 2023
@ariamarble ariamarble moved this from Todo to In Progress in Segment Replication Mar 15, 2023
@ariamarble ariamarble removed the release-notes PR: Include this PR in the automated release notes label Mar 15, 2023
@ariamarble ariamarble added 2 - In progress Issue/PR: The issue or PR is in progress. performance Documentation related to OpenSearch performance labels Mar 15, 2023
@ariamarble ariamarble added 3 - Tech review PR: Tech review in progress 4 - Doc review PR: Doc review in progress 5 - Editorial review PR: Editorial review in progress 6 - Done but waiting to merge PR: The work is done and ready to merge and removed performance Documentation related to OpenSearch performance 2 - In progress Issue/PR: The issue or PR is in progress. 3 - Tech review PR: Tech review in progress 4 - Doc review PR: Doc review in progress 5 - Editorial review PR: Editorial review in progress labels Apr 5, 2023
@github-project-automation github-project-automation bot moved this from In Progress to Done in Segment Replication Apr 18, 2023
@ariamarble ariamarble added Closed - Complete Issue: Work is done and associated PRs closed and removed 6 - Done but waiting to merge PR: The work is done and ready to merge labels Apr 18, 2023
@Rishikesh1159
Copy link
Member

@ariamarble @kolchfa-aws Sorry I forgot to mention this before. We need to let users using segment replication know that Segment Replication currently doesn't support wait_for requests in refresh API. Can we please include this limitation with segment replication in appropriate place.

@ariamarble
Copy link
Contributor

@Rishikesh1159 can do, I'll add a note to the page.

@Rishikesh1159
Copy link
Member

@ariamarble Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Closed - Complete Issue: Work is done and associated PRs closed Sev3 Medium priority. Content that's missing, driven by dev, PM or the community. v2.7.0
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

6 participants