Running instrumented XCTest on AWS Device Farm

[louwers]

I am building the test runner ios_application and submitting the .ipa. And separately I am building the ios_unit_test target and submitting the generated .zip with the XCTest.

It fails to run, getting this error:

	Reason: Cannot test target “RenderTest” on “PDX640618729”: Missing test product at /tmp/scratchEvkwZb.scratch/Productsh3Xt6n/Debug-iphoneos/RenderTestApp.app/PlugIns/RenderTest.xctest

Has anyone else gotten XCTests built with rules_apple to run on AWS Device Farm?

https://docs.aws.amazon.com/devicefarm/latest/developerguide/test-types-ios-xctest.html

Maybe I need to enable "build for testing"?

Edit: It seems like they expect the .xctest to be part of the app.

[tinder-maxwellelliott]

I have successfully used this logic to generate a xctestrun bundle that can run on real devices in Firebase test lab

[louwers]

Awesome, thanks for sharing. I will have a look.

[louwers]

I found a workaround, which is to use rules_xcodeproj with the build_mode set to xcode. And then use:

xcodebuild build-for-testing  -scheme RenderTest -archivePath $DIR -project MapLibre.xcodeproj

I wonder what the rules_apple equivalent of this would be.

[brentleyjones]

I wouldn't rely on build_mode = "xcode", as it doesn't have first class support, and it might go away in the future. #1994, when it lands, would be the rules_apple equivalent.

[louwers]

@brentleyjones We couldn't get our unit tests to work on device without it unfortunately.

[brentleyjones]

Then that's a bug. Can you file an issue? BwX shouldn't be required to have tests work.