Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI *may* not be running all iOS UI tests #19617

Open
Youssef1313 opened this issue Mar 1, 2025 · 1 comment
Open

CI *may* not be running all iOS UI tests #19617

Youssef1313 opened this issue Mar 1, 2025 · 1 comment
Labels
area/tests 🧪 Categorizes an issue or PR as relevant to tests difficulty/tbd Categorizes an issue for which the difficulty level needs to be defined. kind/bug Something isn't working platform/ios 🍎 Categorizes an issue or PR as relevant to the iOS platform triage/untriaged Indicates an issue requires triaging or verification

Comments

@Youssef1313
Copy link
Member

Current behavior

The test filter calculation (starting from this line)

if [ "$UITEST_AUTOMATED_GROUP" == '1' ];

is hardcoding namespaces. It's very possible that a developer accidentally introduce a new namespace that ends up not being tested in CI. Whether or not there is currently such untested tests is something I don't know.

Expected behavior

It may be better to follow the logic from Android where the generator is adding a bucket property and that's what will be used for filtering

How to reproduce it (as minimally and precisely as possible)

No response

Workaround

No response

Works on UWP/WinUI

None

Environment

No response

NuGet package version(s)

No response

Affected platforms

No response

IDE

No response

IDE version

No response

Relevant plugins

No response

Anything else we need to know?

No response

@Youssef1313 Youssef1313 added difficulty/tbd Categorizes an issue for which the difficulty level needs to be defined. kind/bug Something isn't working triage/untriaged Indicates an issue requires triaging or verification platform/ios 🍎 Categorizes an issue or PR as relevant to the iOS platform area/tests 🧪 Categorizes an issue or PR as relevant to tests labels Mar 1, 2025
@jeromelaban
Copy link
Member

Yes, this is expected at this time. A tentative fix was implemented here: #6605, but never ended up finished.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/tests 🧪 Categorizes an issue or PR as relevant to tests difficulty/tbd Categorizes an issue for which the difficulty level needs to be defined. kind/bug Something isn't working platform/ios 🍎 Categorizes an issue or PR as relevant to the iOS platform triage/untriaged Indicates an issue requires triaging or verification
Projects
None yet
Development

No branches or pull requests

2 participants