Skip to content

Run our large test suite in GitHub Actions #969

@apyrgio

Description

@apyrgio

What is the feature you think should be a good addition to Dangerzone?

Dangerzone has a test suite with a large number of documents, that we tend to run before each release. We usually run this locally, but it takes quite a lot of time and space. It would be best to run it in GitHub Actions. The test suite is documented here: https://github.com/freedomofpress/dangerzone/blob/main/docs/developer/TESTING.md

Is your feature request related to a problem? Please describe.

This test suite is useful for detecting regressions in our code, so it's good to run it in regular intervals.

Additional context

Anecdotally, running this test suite locally takes about a day. On the other hand, GitHub's Usage Limits state that jobs can run for a maximum of 6 hours:

Job execution time - Each job in a workflow can run for up to 6 hours of execution time. If a job reaches this limit, the job is terminated and fails to complete.

Luckily, GitHub allows us to run 20 concurrent jobs in our free plan. There are people who have taken advantage of this fact to parallelize their pytest invocations: https://github.com/jerry-git/pytest-split-gh-actions-demo/blob/master/.github/workflows/test.yml

See also:

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestgithub_actionsPull requests that update GitHub Actions code

Type

No type

Projects

Status

PR Review

Relationships

None yet

Development

No branches or pull requests

Issue actions