Skip to content

Filebeat panics when attempting to shutdown while using Kafka output #46109

@khushijain21

Description

@khushijain21

Start filebeat with following configuration

filebeat.inputs:
- type: filestream
  id: my-filestream-id
  enabled: true
  paths:
    - /var/log/*.log

output.kafka:
  hosts: ["localhost:9092"]
  topic: beats 

and then stop it after few seconds. You can observe below panic.

^Cpanic: send on closed channel

goroutine 115 [running]:
github.com/elastic/beats/v7/libbeat/outputs/kafka.(*client).Publish(0x140002c8508, {0x14000713ec0?, 0x2?}, {0x1064a00d0, 0x1400064af00})
        github.com/elastic/beats/v7/libbeat/outputs/kafka/client.go:196 +0x2f8
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*netClientWorker).publishBatch(0x14000622140, {0x1064952e0?, 0x140003d6000?}, {0x1064a00d0?, 0x1400064af00?})
        github.com/elastic/beats/v7/libbeat/publisher/pipeline/client_worker.go:170 +0x174
github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*netClientWorker).run(0x14000622140, {0x1064952e0, 0x140003d6000})
        github.com/elastic/beats/v7/libbeat/publisher/pipeline/client_worker.go:156 +0xcc
created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.makeClientWorker in goroutine 1
        github.com/elastic/beats/v7/libbeat/publisher/pipeline/client_worker.go:75 +0x1d8

Metadata

Metadata

Assignees

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions