Unable to reporduce results

[pulkitkumar95]

Hey,

First of all, great work. I really enjoyed reading the paper and going over the code. I am working towards an extension of this work, and as a first step, I ran your code just to see if I could reproduce your results. But for some reason, I am not able to match the performance. I ran for two settings, SSV2-small and Kinetics, for a 5-way 1-shot setting with the config files provided. The numbers reported in the paper are 42.7 and 74.0, respectively, in the two settings. However, I see a performance of 39.8 and 71.9 after training with your code. Could you help me in figuring out why the performance drop is there? As mentioned in README, I have just changed the paths, keeping the rest of the things constant.

If possible, could you release your models? That will help me to debug, too.

Thank you!

[ssp-seven]

Hello, how can I test and get the performance result? Thank you very much.

[kktofcon]

Will the code early stop？and how to test and get Indicator.Thank you.