[Flaky Test]: TestSensitiveIncludeSourceOnError – Condition never satisfied

[pchila]

Failing test case

TestSensitiveIncludeSourceOnError

Error message

"0" is not greater than or equal to "1"

Build

https://buildkite.com/elastic/elastic-agent/builds/30956#019ab88d-d76a-4845-be5c-0b41d81dfb51/4420-4576

OS

Linux

Stacktrace and notes

beat_receivers_test.go:1447:
        	Error Trace:	/opt/buildkite-agent/builds/bk-agent-prod-gcp-1764032910730316371/elastic/elastic-agent/testing/integration/ess/beat_receivers_test.go:1455
        	            				/opt/buildkite-agent/.asdf/installs/golang/1.24.10/go/src/runtime/asm_amd64.s:1700
        	Error:      	"0" is not greater than or equal to "1"
    beat_receivers_test.go:1447:
        	Error Trace:	/opt/buildkite-agent/builds/bk-agent-prod-gcp-1764032910730316371/elastic/elastic-agent/testing/integration/ess/beat_receivers_test.go:1447
        	Error:      	Condition never satisfied
        	Test:       	TestSensitiveIncludeSourceOnError

[elasticmachine]

Pinging @elastic/elastic-agent (Team:Elastic-Agent)

[swiatekm]

I can see some potentially relevant errors in the logs:

{"log.level":"error","@timestamp":"2025-11-25T01:32:19.446Z","message":"Could not init registrar: failed to open store 'filebeat': can not read store meta file: EOF","otelcol.component.id":"filebeatreceiver/_agent-component/filestream-default","otelcol.component.kind":"receiver","ecs.version":"1.6.0","log.origin":{"file.line":338,"file.name":"beater/filebeat.go","function":"github.com/elastic/beats/v7/filebeat/beater.(*Filebeat).Run"},"resource":{"service.instance.id":"b5d69ace-e54d-4c68-9740-df4993b86906","service.name":"/opt/Elastic/Agent/data/elastic-agent-8.19.8-SNAPSHOT-18dd59/elastic-agent","service.version":"8.19.8"},"otelcol.signal":"logs","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-default","type":"filestream"},"log":{"source":"filestream-default"},"service.name":"filebeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2025-11-25T01:32:19.446Z","message":"error starting filebeat receiver{error 26 0  beat receiver run error: failed to open store 'filebeat': can not read store meta file: EOF}","resource":{"service.instance.id":"b5d69ace-e54d-4c68-9740-df4993b86906","service.name":"/opt/Elastic/Agent/data/elastic-agent-8.19.8-SNAPSHOT-18dd59/elastic-agent","service.version":"8.19.8"},"otelcol.component.id":"filebeatreceiver/_agent-component/filestream-default","log.origin":{"file.line":29,"file.name":"fbreceiver/receiver.go","function":"github.com/elastic/beats/v7/x-pack/filebeat/fbreceiver.(*filebeatReceiver).Start.func1"},"otelcol.component.kind":"receiver","otelcol.signal":"logs","component":{"binary":"filebeat","dataset":"elastic_agent.filebeat","id":"filestream-default","type":"filestream"},"log":{"source":"filestream-default"},"service.name":"filebeat","ecs.version":"1.6.0","ecs.version":"1.6.0"}

It looks like filebeat receiver simply didn't run because it couldn't open the registry, but also didn't report its own status as failed. That's a bug that we should fix, but it's not the root cause of the actual issue.

It looks like the state file was present, but also empty. Not sure how that could happen. The file in the diagnostics is correct, but the transaction log is the same as the one from the monitoring receiver, so we might have a bug there as well.

[swiatekm]

This should be fixed once elastic/beats#47829 is merged and makes its way to the agent go.mod.

[swiatekm]

#11507 should fix it for 9.2 and main.