-
Notifications
You must be signed in to change notification settings - Fork 480
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Data Prepper 2.10.0 release blog #3381
Data Prepper 2.10.0 release blog #3381
Conversation
Co-authored-by: Souvik Bose <[email protected]> Signed-off-by: David Venable <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@dlvenable Initial editorial review complete. Please see my comments and changes and tag me for approval once addressed. Thanks!
- releases | ||
excerpt: Data Prepper 2.10.0 offers an OpenSearch _bulk API and reads from Amazon Kinesis | ||
meta_keywords: Data Prepper, _bulk, Amazon Kinesis Data Streams, OTel Logs, OTLP JSON | ||
meta_description: Data Prepper 2.10.0 offers a source that simulates the OpenSearch _bulk API and another source for reading from Amazon Kinesis Data Streams. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Updated meta:
meta_keywords: Data Prepper, OpenSearch bulk API, Kinesis data streams, Kafka, SASL/SCRAM authentication, streaming data ingestion
meta_description: Data Prepper 2.10.0 adds OpenSearch API and Kinesis Data Streams sources for seamless ingestion, plus Kafka SASL/SCRAM support and OpenTelemetry log parsing.
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: David Venable <[email protected]>
2a44566
to
98fe5b7
Compare
Signed-off-by: David Venable <[email protected]>
…nsearch-project#3386. Signed-off-by: David Venable <[email protected]>
@natebower , I made all the changes. I will be pushing the Thank You text soon as well. Also, my co-author has a PR for a profile that we will need merged. #3386 |
{ "title": "Rush", "year": 2013 } | ||
``` | ||
|
||
This request will be ingested into OpenSearch, and a new document will be created under the index `movies` with the document ID `tt1979320` with a document source of `{ "title": "Rush", "year": 2013 }`. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This request will be ingested into OpenSearch, and a new document will be created under the index `movies` with the document ID `tt1979320` with a document source of `{ "title": "Rush", "year": 2013 }`. | |
This request will be ingested into OpenSearch, and a new document will be created under the index `movies` with the document ID `tt1979320` and the document source `{ "title": "Rush", "year": 2013 }`. |
Signed-off-by: David Venable <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @dlvenable! LGTM with the minor edits to lines 24 and 73.
Cc: @pajuric
## OpenSearch API source | ||
|
||
Many existing OpenSearch clients that perform ingestion directly to OpenSearch can now send that data to Data Prepper first. | ||
With this, you can use Data Prepper's buffering and rich processor set before sending data to OpenSearch without having to change clients that are using the OpenSearch `_bulk` API. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
With this, you can use Data Prepper's buffering and rich processor set before sending data to OpenSearch without having to change clients that are using the OpenSearch `_bulk` API. | |
This means that you can use Data Prepper's buffering and rich processor set before sending data to OpenSearch without having to change clients that are using the OpenSearch `_bulk` API. |
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: David Venable <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: David Venable <[email protected]>
@natebower , I made both of your last two suggestions. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@dlvenable @pajuric LGTM
@nateynateynate @krisfreedain - Blog is ready to go live! Let's get it posted. |
@nateynateynate @kolchfa-aws - are you able to help with pushing this live. It never pushed out yesterday. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Description
This PR adds the release blog post for Data Prepper 2.10. This post was written by @dlvenable and @sb2k16 who will create a separate PR with his profile.
We can start the review while we wait on us getting the profile for @sb2k16 and our Thank You text updated.
Tasks for our team before merging:
Issues Resolved
Resolves #3371
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the BSD-3-Clause License.