You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There are two identical data (the 6th and 506th data) in the hotpot.json file.
So when you run the results of ircot_hipporag.py on the hotpotqa data, if you interrupt halfway (idx>=6) and rerun the code, due to this mechanism, you will skip the 506th data and only get the results of 999 data.
But the results of using 1000 data but with the same data may not necessarily be better than the results of 999 data.
The text was updated successfully, but these errors were encountered:
There are two identical data (the 6th and 506th data) in the
hotpot.json
file.So when you run the results of
ircot_hipporag.py
on thehotpotqa
data, if you interrupt halfway (idx>=6) and rerun the code, due to this mechanism, you will skip the 506th data and only get the results of 999 data.But the results of using 1000 data but with the same data may not necessarily be better than the results of 999 data.
The text was updated successfully, but these errors were encountered: