为了访问kafka 0.9
logstash:6.8.13 logstash:6.3.0
更改了kafka-output-plugin
添加两项kafka事务参数 支持 max_in_flight_requests_per_connection和enable_idempotence两项参数的传入
示例
output{
kafka {
acks => "all"
codec => "json"
topic_id => "test_topic"
bootstrap_servers =>"a:9092,b:9092,c:9092"
batch_size => 2048
max_request_size =>512000
max_in_flight_requests_per_connection => 1
enable_idempotence => "true"
}
}
| log stash version | logstash-output-kafka version | kafka-client version |
|---|---|---|
| 6.3.0 | logstash-output-kafka-7.0.10 | 1.0 |
| 6.8.13 | logstash-output-kafka-7.3.2.gem | 2.1.0 |
Content type
Image
Digest
Size
145.3 MB
Last updated
over 5 years ago
docker pull cclient/logstash:2.4-alpine-kfk-0.9