Skip to content

chore: eval test to release workflow #573

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

friedrichwilken
Copy link
Collaborator

Description

Changes proposed in this pull request:

  • ...
  • ...
  • ...

Related issue(s)

Copy link

Note(s) for PR Auther:

  • The integration test will be skipped for the PR. You can trigger it manually after adding the label: run-integration-test.
  • The evaluation test will be skipped for the PR. You can trigger it manually after adding the label: evaluation requested.
  • If any changes are made to the evaluation tests data, make sure that the integration tests are working as expected.
  • If any changes are made to how to run the unit tests, make sure to update the steps for unit-tests in the create-release.yml workflow as well.

Note(s) for PR Reviewer(s):

  • Make sure that the integration and evaluation tests are working as expected.

@friedrichwilken friedrichwilken changed the title Add eval test to release workflow chore: eval test to release workflow Jun 15, 2025
@@ -38,7 +37,6 @@ on:
# global env variables.
env:
REPOSITORY_FULL_NAME: "${{ github.repository }}" # <owner>/<repository-name>.
IMAGE_NAME: "europe-docker.pkg.dev/kyma-project/prod/kyma-companion" # without tag.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Collaborator Author

@friedrichwilken friedrichwilken Jun 20, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a draft and not ready for review.

## in the run-integration-test.yaml workflow as well.
name: Run evaluation tests
env:
IMAGE_NAME: "europe-docker.pkg.dev/kyma-project/prod/kyma-companion" # without tag.
Copy link
Member

@mfaizanse mfaizanse Jun 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is without tag. At this stage in the pipeline, we have not build the image for the tag.
So, I think we can use the ref/sha to fetch status of build job of that commit, and use that tag to test.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For example: europe-docker.pkg.dev/kyma-project/prod/kyma-companion:7ba3567babc5cb8c494a83dc4e291d14deee9666

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so,

  1. Get the SHA of head commit from release branch.
  2. Use the image europe-docker.pkg.dev/kyma-project/prod/kyma-companion:<SHA>

You would need another job to compute the image name and export it as job output, to use it in with section. Example.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a draft and not ready for review.

@mfaizanse mfaizanse closed this Jul 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants