Request for COCO-Search18 and COCO-FreeView Datasets Test Split (test.json)

[ttt0666]

I am currently working on this topic, which utilizes the COCO-Search18 and COCO-FreeView datasets. However, I noticed that the official website of the dataset no longer provides the test.json file. Additionally, it is unclear when the online evaluation system will be available again.

To proceed with our experiments and ensure a fair comparison, I would be grateful if you could kindly share the test.json file with us. This would allow us to conduct the testing locally and validate our implementation.

Please let me know if this is feasible. I greatly appreciate your time and assistance.

Thank you in advance for your support!

Best regards

[giuseppecartella]

Hi @ttt0666 ,
Thank you for the interest in our work!

It is true that the test splits of both COCO-Search18 and COCO-FreeView are not officially released by the authors and are not available online. However it is possible to recover the test split of cocosearch18 (both TP and TA) from the github repositories (gazeformer) and gdrive

Instead, the COCOFreeView test split is not available anywhere, thus, we redefined a train-val-split setting from the training and validation splits.

However, we plan to release all the splits used in our work to guarantee a fair comparision, in few days.
Stay tuned,
Best,
Giuseppe