Regarding Performance Monitoring #639
-
|
Hi author, I would like to know if the Malcolm component has any backlog in the collection rate of Filebeat, as well as the forwarding rate of Logstash. Do you have a monitoring plan |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
Filebeat has some capabilities to reestablish connections to Logstash and continue forwarding when the connection is lost, but I don't think we're doing anything specific to adjust it from the defaults. You can monitor the logstash pipelines via the pipeline API which is available via the Malcolm API at If you are using an external elasticsearch or opensearch instance, then Logstash uses a persistent queue in case the connection to the data store is lost. When Malcolm uses its own embedded opensearch instance, it uses whatever logstash's default queue type is. I'm not sure what you mean by "monitoring plan". |
Beta Was this translation helpful? Give feedback.
Filebeat has some capabilities to reestablish connections to Logstash and continue forwarding when the connection is lost, but I don't think we're doing anything specific to adjust it from the defaults.
You can monitor the logstash pipelines via the pipeline API which is available via the Malcolm API at
/mapi/logstash/.If you are using an external elasticsearch or opensearch instance, then Logstash uses a persistent queue in case the connection to the data store is lost. When Malcolm uses its own embedded opensearch instance, it uses whatever logstash's default queue type is.
I'm not sure what you mean by "monitoring plan".