[BUG] CagraRandomizedIT.testResultsTopKWithRandomValues failing

[ldematte]

CagraRandomizedIT.testResultsTopKWithRandomValues is failing with seed D5CB55DBD1FD6C0

To reproduce, simply run

mvn clean integration-test -Dit.test=com.nvidia.cuvs.CagraRandomizedIT#testResultsTopKWithRandomValues -Dtests.seed=D5CB55DBD1FD6C0

in cuvs/java/cuvs-java.

EDIT: I was able to reproduce the failure with this seed in the command line, now I cannot do that anymore. So strange :(

Fixing the seed on the test works (as in, it still fails) though:

@RunWith(RandomizedRunner.class)
@Seed("D5CB55DBD1FD6C0")
public class CagraRandomizedIT extends CuVSTestCase 

Second EDIT: it's actually -Dtests.seed=D5CB55DBD1FD6C0

[mythrocks]

Thanks for filing this. It's high time this was addressed. This random failure is causing unnecessary churn.

Until this is addressed, it might make sense to hard-code a rand-seed that allows the tests to pass. It will save on the wasted time and compute.

[ldematte]

Until this is addressed, it might make sense to hard-code a rand-seed that allows the tests to pass. It will save on the wasted time and compute.

Agreed; we can collect some seeds to repro the issue (more than 1 just to be safe) and then de-randomize it.