Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Meta] Migrations to OpenSearch #3757

Open
setiah opened this issue Jul 1, 2022 · 7 comments
Open

[Meta] Migrations to OpenSearch #3757

setiah opened this issue Jul 1, 2022 · 7 comments
Labels
enhancement Enhancement or improvement to existing feature or request feature New feature or request feedback needed Issue or PR needs feedback

Comments

@setiah
Copy link
Contributor

setiah commented Jul 1, 2022

The purpose of this issue is track any gaps or issues users face in migrating their workloads to OpenSearch or within OpenSearch (for example, version upgrades). Since Migrations is a broad topic, this meta issue would be helpful in capturing and linking back all migration related pieces together at one place.

The scope of Migrations includes but is not limited to -

  • Migration from previous Elasticsearch versions to any OpenSearch version
  • Migration from ODFE to OpenSearch
  • Migration from a lower OpenSearch version to higher OpenSearch version
  • Migration of plugins
  • Migration on any platform (RPM, Windows, Docker, etc.)
  • Recommended tools/mechanisms available for migration.
  • Areas of opportunities to build new tools/mechanisms for migrations
  • Gaps in the documentation w.r.t. Migration.

This issue is open for feedback and discussions.

@setiah setiah added enhancement Enhancement or improvement to existing feature or request untriaged labels Jul 1, 2022
@setiah
Copy link
Contributor Author

setiah commented Jul 1, 2022

One area of improvement is lack of a good documentation that can serve as a migration guide. Created this issue for tracking opensearch-project/documentation-website#745

@setiah
Copy link
Contributor Author

setiah commented Jul 1, 2022

Some other areas called out by the community that lack migration support -

  1. Migration of x-pack plugins to OpenSearch plugins. For instance, migrating x-pack Security to OpenSearch Security plugin, same for alerting and others.
  2. Missing Spring Data integration [PROPOSAL] Introduce spring-data-opensearch to support OpenSearch integration spring-projects/spring-data-elasticsearch#1918

@reta
Copy link
Collaborator

reta commented Jul 4, 2022

Add flattened field type - #1018
Support for unsigned_long as same as in elastic search - #3538
Adding 'dense_vector' field type - #3659

@setiah
Copy link
Contributor Author

setiah commented Jul 5, 2022

Snapshotting plugin configurations for simple restore like data for easy migration of plugins - #3507

@brijos
Copy link

brijos commented Jul 11, 2022

This is what we are tracking as migration blockers for language and ingestion clients....

Hadoop client - opensearch-project/opensearch-hadoop#134
Logstash 8 support - opensearch-project/logstash-output-opensearch#132
Logstash Filter plugin support - opensearch-project/opensearch-clients#4

@mch2 mch2 added feedback needed Issue or PR needs feedback feature New feature or request and removed untriaged labels Jul 11, 2022
@setiah
Copy link
Contributor Author

setiah commented Jul 12, 2022

Migration from x-pack flattened data types to OpenSearch https://forum.opensearch.org/t/migration-via-snapshot-restore-mapping-roadblocks/7906

@setiah
Copy link
Contributor Author

setiah commented Nov 15, 2022

Tagging opensearch-project/opensearch-ruby#50 here as ruby client is important for ruby users to migrate to OpenSearch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement or improvement to existing feature or request feature New feature or request feedback needed Issue or PR needs feedback
Projects
None yet
Development

No branches or pull requests

4 participants