-
Notifications
You must be signed in to change notification settings - Fork 3.5k
[main] (backport #17781) Harmonize observability sre acceptance #18001
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
* Move ES config from ENV to file * Use fips filebeat impl for smoke tests * Standardize container orchestration Make rspec responsible for container orchestration. DRY shared functionality. * Ensure we test against the right versions Dynamically look up the version of logstash and test against the corresponding ES image. Also, extract this to make local dev easier. (cherry picked from commit 1195743)
🤖 GitHub commentsExpand to view the GitHub comments
Just comment with:
|
This is the failure
|
There is a bug in the 9.2.0 series of ES fips preventing us from using it in CI Pin to 8.19.3 for now.
2cca606
to
49297fa
Compare
Explicitly require fips provider and use fipsmode
This commit updates filebeat to use the 9 series format and increases the log size with new minimum 1024 char size to start streaming. This also updates the default stack version to 9.2 (currently that is version that tracks main) and adds some more logging to help see what is going on during docker-compose and wait.
new run based on updates: https://buildkite.com/elastic/logstash-exhaustive-tests-pipeline/builds/2336 |
|
💚 Build Succeeded
History
cc @donoghuc |
When working on porting tests to elastic#18001 the main LS branch we started testing against the 9.2 series of the ES stack. There were some required changes there (listed below) that are 8.19 compatable. This commit ports those changes to the 8.19 series to keep them as close as possible. 1. Elasticsearch container needs explicit fips config to boot 2. Filebeat needs > 64k file size to start filestream processing 3. Generally the logging in the shared helpers was updated to make reasoning about the state of failures easier in log output.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Tests are green! I opened #18014 to backport all the changes necessary to use the 9.2 stack as they are all 8.19 compatable. This makes 8.19 more future proof and keeps things consistent.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. 👍🏼
When working on porting tests to #18001 the main LS branch we started testing against the 9.2 series of the ES stack. There were some required changes there (listed below) that are 8.19 compatable. This commit ports those changes to the 8.19 series to keep them as close as possible. 1. Elasticsearch container needs explicit fips config to boot 2. Filebeat needs > 64k file size to start filestream processing 3. Generally the logging in the shared helpers was updated to make reasoning about the state of failures easier in log output.
Release notes
[rn:skip]
What does this PR do?
Harmonize the testing of observability SRE container artifacts:
Why is it important/What is the impact to the user?
NA
Checklist
Related issues
This is an automatic backport of pull request #17781 done by [Mergify](https://mergify.com).