- Update kafka client to 3.7.1 and transitive dependencies #186
- Update avro to 1.11.4 and confluent kafka to 7.4.7 #184
- Specify that only headers with UTF-8 encoded values are supported in extended decoration #174
- Add "auto_create_topics" option to allow disabling of topic auto creation #172
- Add default client_id of logstash to kafka output #169
- [DOC] Match anchor ID and references for
message_headers
#164
- Add support for setting Kafka message headers in output plugin #162
- Fix "retries" and "value_serializer" error handling in output plugin (#160) #160
- Fix "Can't modify frozen string" error when record value is
nil
(tombstones) #155
- Fix: update Avro library #150
- Fix: update snappy dependency #148
- Bump kafka client to 3.4.1 #145
- Fix nil exception to empty headers of record during event metadata assignment #140
- Added TLS truststore and keystore settings specifically to access the schema registry #137
- Added config
group_instance_id
to use the Kafka's consumer static membership feature #135
- Changed Kafka client to 3.3.1, requires Logstash >= 8.3.0.
- Deprecated
default
value for settingclient_dns_lookup
forcing touse_all_dns_ips
when explicitly used #130 - Changed the consumer's poll from using the one that blocks on metadata retrieval to the one that doesn't #136
- Fix: update Avro library on 10.x #149
- bump kafka client to 2.8.1 #115
- Feat: added connections_max_idle_ms setting for output #118
- Refactor: mixins to follow shared mixin module naming
- Update CHANGELOG.md #114
- Added config setting to enable 'zstd' compression in the Kafka output #112
- Refactor: leverage codec when using schema registry #106
Previously using
schema_registry_url
parsed the payload as JSON even ifcodec => 'plain'
was set, this is no longer the case.
- [DOC] Updates description of
enable_auto_commit=false
to clarify that the commit happens after data is fetched AND written to the queue #90 - Fix: update to Gradle 7 #104
- [DOC] Clarify Kafka client does not support proxy #103
- [DOC] Removed a setting recommendation that is no longer applicable for Kafka 2.0+ #99
- Added config setting to enable schema registry validation to be skipped when an authentication scheme unsupported by the validator is used #97
- Fix: Correct the settings to allow basic auth to work properly, either by setting
schema_registry_key/secret
or embedding username/password in the url #94
- Test: specify development dependency version #91
- Improved error handling in the input plugin to avoid errors 'escaping' from the plugin, and crashing the logstash process #87
- Docs: make sure Kafka clients version is updated in docs #83 Since 10.6.0 Kafka client was updated to 2.5.1
- Changed
decorate_events
to add also Kafka headers #78
- Update Jersey dependency to version 2.33 #75
- Fix: dropped usage of SHUTDOWN event deprecated since Logstash 5.0 #71
- Switched use from Faraday to Manticore as HTTP client library to access Schema Registry service to fix issue #63
- Added functionality to Kafka input to use Avro deserializer in retrieving data from Kafka. The schema is retrieved from an instance of Confluent's Schema Registry service #51
- Fix: set (optional) truststore when endpoint id check disabled #60.
Since 10.1.0 disabling server host-name verification (
ssl_endpoint_identification_algorithm => ""
) did not allow the (output) plugin to setssl_truststore_location => "..."
.
- Docs: explain group_id in case of multiple inputs #59
- [DOC]Replaced plugin_header file with plugin_header-integration file. #46
- [DOC]Update kafka client version across kafka integration docs #47
- [DOC]Replace hard-coded kafka client and doc path version numbers with attributes to simplify doc maintenance #48
- Changed: retry sending messages only for retriable exceptions #27
- [DOC] Fixed formatting issues and made minor content edits #43
- added the input
isolation_level
to allow fine control of whether to return transactional messages #44
- added the input and output
client_dns_lookup
parameter to allow control of how DNS requests are made #28
- Changed: config defaults to be aligned with Kafka client defaults #30
- updated kafka client (and its dependencies) to version 2.4.1 (#16)
- added the input
client_rack
parameter to enable support for follower fetching - added the output
partitioner
parameter for tuning partitioning strategy - Refactor: normalized error logging a bit - make sure exception type is logged
- Fix: properly handle empty ssl_endpoint_identification_algorithm #8
- Refactor : made
partition_assignment_strategy
option easier to configure by accepting simple values from an enumerated set instead of requiring lengthy class paths (#25)
- Fix links in changelog pointing to stand-alone plugin changelogs.
- Refactor: scope java_import to plugin class
- Initial release of the Kafka Integration Plugin, which combines previously-separate Kafka plugins and shared dependencies into a single codebase; independent changelogs for previous versions can be found: