Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement search result comparison #108

Open
wrigleyDan opened this issue Feb 12, 2025 · 0 comments
Open

Implement search result comparison #108

wrigleyDan opened this issue Feb 12, 2025 · 0 comments

Comments

@wrigleyDan
Copy link
Collaborator

Implementation of the search result comparison

For each query of a query set:

  1. Get the results for the specified search configs
  2. Calculate Jaccard@k & RBO@k
  3. Store the result per query in the result comparison metrics index

Executable from the command line.

Takes a configuration file as input that specifies the query set, the result sets, the metrics to be calculated, the depth (@k) for which the metrics are to be calculated.

Do we want a new/separate index for these?

@wrigleyDan wrigleyDan added this to the Eyeballing Tool milestone Feb 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant