Skip to content

Conversation

@ymao1
Copy link
Contributor

@ymao1 ymao1 commented Dec 2, 2025

Fixes #237285

Summary

The serverless version of these tests were failing with Response aborted while reading the body errors, which means the report is short-circuiting before completing. I noticed a previous change #185878 to increase the time the test waits for a report to 10m however, the queue timeout for reporting was still set to the default 4m so this increases the queue timeout for reporting to 10m in these tests to give it more time to complete.

This should also address the following tests (all failed due to Response aborted while reading the body):

Flaky test runner runs:
There were some failures but seem unrelated...


2025-12-02 22:03:51 UTC | ERROR UNHANDLED ERROR
-- | --
2025-12-02 22:03:51 UTC | ERROR ResponseError: index_not_found_exception
2025-12-02 22:03:51 UTC | Root causes:
2025-12-02 22:03:51 UTC | index_not_found_exception: no such index [.kibana-event-log-ds]
2025-12-02 22:03:51 UTC | at SniffingTransport._request (/opt/buildkite-agent/builds/bk-agent-prod-gcp-1764712453512576396/elastic/kibana-flaky-test-suite-runner/kibana/node_modules/@elastic/elasticsearch/node_modules/@elastic/transport/src/Transport.ts:591:17)
2025-12-02 22:03:51 UTC | at processTicksAndRejections (node:internal/process/task_queues:105:5)
2025-12-02 22:03:51 UTC | at /opt/buildkite-agent/builds/bk-agent-prod-gcp-1764712453512576396/elastic/kibana-flaky-test-suite-runner/kibana/node_modules/@elastic/elasticsearch/node_modules/@elastic/transport/src/Transport.ts:697:22
2025-12-02 22:03:51 UTC | at SniffingTransport.request (/opt/buildkite-agent/builds/bk-agent-prod-gcp-1764712453512576396/elastic/kibana-flaky-test-suite-runner/kibana/node_modules/@elastic/elasticsearch/node_modules/@elastic/transport/src/Transport.ts:694:14)
2025-12-02 22:03:51 UTC | at Indices.putSettings (/opt/buildkite-agent/builds/bk-agent-prod-gcp-1764712453512576396/elastic/kibana-flaky-test-suite-runner/kibana/node_modules/@elastic/src/api/api/indices.ts:3529:12)
2025-12-02 22:03:51 UTC | at putFastRefreshSettings (es.ts:54:5)
2025-12-02 22:03:51 UTC | at es.ts:142:5
2025-12-02 22:03:51 UTC | at lifecycle_phase.ts:77:11
2025-12-02 22:03:51 UTC | at async Promise.all (index 2)
2025-12-02 22:03:51 UTC | at LifecyclePhase.trigger (lifecycle_phase.ts:74:5)
2025-12-02 22:03:51 UTC | at functional_test_runner.ts:115:9
2025-12-02 22:03:51 UTC | at FunctionalTestRunner.runHarness (functional_test_runner.ts:267:14)
2025-12-02 22:03:51 UTC | at FunctionalTestRunner.run (functional_test_runner.ts:49:12)
2025-12-02 22:03:51 UTC | at runFtr (run_ftr.ts:24:24)
2025-12-02 22:03:51 UTC | at run_tests.ts:180:11
2025-12-02 22:03:51 UTC | at withProcRunner (with_proc_runner.ts:30:5)
2025-12-02 22:03:51 UTC | at run_tests.ts:105:7
2025-12-02 22:03:51 UTC | at tooling_log.ts:95:18
2025-12-02 22:03:51 UTC | at runTests (run_tests.ts:67:5)
2025-12-02 22:03:51 UTC | at description (cli.ts:25:7)
2025-12-02 22:03:51 UTC | at run.ts:69:10
2025-12-02 22:03:51 UTC | at withProcRunner (with_proc_runner.ts:30:5)
2025-12-02 22:03:51 UTC | at run (run.ts:67:5)

@ymao1 ymao1 changed the title Increasing reporting timeout Fixes flaky serverless reporting tests Dec 2, 2025
@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#9963

[❌] x-pack/platform/test/serverless/api_integration/configs/observability/config.group1.ts: 173/200 tests passed.

see run history

@ymao1 ymao1 self-assigned this Dec 3, 2025
@ymao1 ymao1 added release_note:skip Skip the PR/issue when compiling release notes Team:ResponseOps Platform ResponseOps team (formerly the Cases and Alerting teams) t// Feature:Reporting:Framework Reporting issues pertaining to the overall framework v9.3.0 v9.2.3 labels Dec 3, 2025
@ymao1 ymao1 marked this pull request as ready for review December 3, 2025 23:06
@ymao1 ymao1 requested a review from a team as a code owner December 3, 2025 23:06
@elasticmachine
Copy link
Contributor

Pinging @elastic/response-ops (Team:ResponseOps)

@ymao1 ymao1 added the backport:version Backport to applied version labels label Dec 3, 2025
@elasticmachine
Copy link
Contributor

elasticmachine commented Dec 3, 2025

💔 Build Failed

Failed CI Steps

Test Failures

  • [job] [logs] FTR Configs #34 / lens app - group 2 lens layer actions tests should add a new visualization layer and disable the sampling if max operation is chosen
  • [job] [logs] FTR Configs #117 / Maps endpoints apis search ES|QL should return getValues response in expected shape
  • [job] [logs] FTR Configs #117 / Maps endpoints apis search ES|QL should return getValues response in expected shape

Metrics [docs]

✅ unchanged

History

cc @ymao1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:version Backport to applied version labels Feature:Reporting:Framework Reporting issues pertaining to the overall framework release_note:skip Skip the PR/issue when compiling release notes Team:ResponseOps Platform ResponseOps team (formerly the Cases and Alerting teams) t// v9.2.3 v9.3.0

Projects

None yet

3 participants