Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update readme with quickstart steps #283

Merged
merged 4 commits into from
May 24, 2024
Merged

Update readme with quickstart steps #283

merged 4 commits into from
May 24, 2024

Conversation

muralibasani
Copy link
Contributor

@muralibasani muralibasani commented May 18, 2024

This PR updates the below.

  • There is a worker properties file which is still in the name of elasticsearch. Renamed to opensearch
  • Updated readme file with quickstart steps
  • As this connector is a sink connector, updated the heading.

TODO (new pr)

  • Need to change import org.opensearch.common.xcontent.XContentType; to XContentTypeFactory.
  • this import org.opensearch.index.VersionType fails
  • move integration tests to tests folder

@muralibasani muralibasani requested review from a team as code owners May 18, 2024 12:25
Copy link

@Claudenw Claudenw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the structure should be front to back. I should not have to stop and install new stuff part way through. All the required components should be listed at the beginning.

README.md Outdated
3. Add OpenSearch Sink to Kafka Connect: Follow the 'How to install' instructions to add the OpenSearch sink connector to Kafka Connect. Example worker config is located here https://github.com/Aiven-Open/opensearch-connector-for-apache-kafka/blob/main/config/quickstart-opensearch.properties
4. Verify plugin installation : Visit http://localhost:8083/connectors to confirm that the OpenSearch sink connector is listed
5. Check ACLs (If Enabled): If ACLs are enabled on Kafka, ensure there are no authorization exceptions for the topic and group resources.
6. Install and Run OpenSearch: Ensure OpenSearch is installed and running. If SSL is enabled, configure the credentials in the connector worker properties.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't this come at the beginning? It seems like you should have a single first step:

  1. Install and configure required software:
    1. Install and Run Kafka (link to install notes)
    2. Install and Run Kafka Connect (link to install notes)
    3. Install and Run OpenSearch (link to install notes) Mention SSL issue

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Claudenw good one. Updated.

README.md Outdated
2. Run Kafka Connect: Make sure Kafka Connect is up and running.
3. Add OpenSearch Sink to Kafka Connect: Follow the 'How to install' instructions to add the OpenSearch sink connector to Kafka Connect. Example worker config is located here https://github.com/Aiven-Open/opensearch-connector-for-apache-kafka/blob/main/config/quickstart-opensearch.properties
4. Verify plugin installation : Visit http://localhost:8083/connectors to confirm that the OpenSearch sink connector is listed
5. Check ACLs (If Enabled): If ACLs are enabled on Kafka, ensure there are no authorization exceptions for the topic and group resources.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What should one do if there are ACLs enabled? Is there a setting in the OpenSearch Sink or someplace to fix the problem?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated with links.

README.md Outdated

1. Install and Run Kafka: Ensure Kafka is properly installed and running.
2. Run Kafka Connect: Make sure Kafka Connect is up and running.
3. Add OpenSearch Sink to Kafka Connect: Follow the 'How to install' instructions to add the OpenSearch sink connector to Kafka Connect. Example worker config is located here https://github.com/Aiven-Open/opensearch-connector-for-apache-kafka/blob/main/config/quickstart-opensearch.properties

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you can replace 1. and 2. in this list with "Ensure that the required software is installed and running"
You can then also drop 6 and 7 from this list as it is covered in the required software..

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah yes. done.

@muralibasani muralibasani requested a review from Claudenw May 21, 2024 14:44
Copy link

@Claudenw Claudenw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM -- thx for the changes.

@muralibasani muralibasani merged commit 6ab08e5 into main May 24, 2024
16 checks passed
@muralibasani muralibasani deleted the minor-changes branch May 24, 2024 13:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants