Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement change-based metrics #107

Open
2 tasks
wrigleyDan opened this issue Feb 12, 2025 · 0 comments
Open
2 tasks

Implement change-based metrics #107

wrigleyDan opened this issue Feb 12, 2025 · 0 comments

Comments

@wrigleyDan
Copy link
Collaborator

wrigleyDan commented Feb 12, 2025

Change needs to be quantified when comparing query results.

The following metrics are implemented:

  • Rank-biased overlap
  • Jaccard

Both metrics can be are calculated for a specific depth which is configurable.

Metrics are calculated per query. Always, two result sets are compared. Per query both metrics calculations take two result sets as their input and return the metrics (a decimal in the range between 0 and 1).

@wrigleyDan wrigleyDan added this to the Eyeballing Tool milestone Feb 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant