-
Notifications
You must be signed in to change notification settings - Fork 3.5k
Open
Labels
Description
Logstash information:
Please include the following information:
- Logstash version (e.g.
bin/logstash --version
):9.2.0-SNAPSHOT
- Logstash installation source (e.g. built from source, with a package manager: DEB/RPM, expanded from tar or zip archive, docker) N/A
- How is Logstash being run (e.g. as a service/service manager: systemd, upstart, etc. Via command line, docker/kubernetes) N/A
Description of the problem including expected versus actual behavior:
In #17229 changes to the buffered tokenizer introduce an edge-case where an oversized sequence of bytes that do not include a delimiter can be silently dropped.
This occurs because size validation happens after the token is fully accumulated, which does not occur if no trailing separator is detected.
Steps to reproduce:
Please include a minimal but complete recreation of the problem,
including (e.g.) pipeline definition(s), settings, locale, etc. The easier
you make for us to reproduce it, the more likely that somebody will take the
time to look at it.
Provide logs (if relevant):