Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: add support for AIMon reranker #3442

Open
wants to merge 19 commits into
base: main
Choose a base branch
from

Conversation

devvratbhardwaj
Copy link

@devvratbhardwaj devvratbhardwaj commented Feb 26, 2025

This pull request implements the integration of the AIMon reranker as described in Issue #3441. The changes include:

  1. Incorporating the AIMon reranker into the cross encoder pipeline.
  2. Adding support for domain-specific task definitions in DatasetConfiguration settings.

The AIMon reranker exceeds in benchmarks and allows users to specify their domain, providing context-specific reranking for improved relevance.

Here's a GIF demonstrating how to use the AIMon reranker:
aimon_reranker

Additionally, below are images showcasing the AIMon reranking server timing tests:
latency_3
latency_2
latency_1

@skeptrunedev skeptrunedev changed the title Added support for AIMon reranker feature: add support for AIMon reranker Feb 26, 2025
@devvratbhardwaj devvratbhardwaj force-pushed the aimon branch 2 times, most recently from 4eda1ef to cef3234 Compare February 28, 2025 02:25
@pjoshi30
Copy link

@skeptrunedev @densumesh please let us know if you have any feedback on this PR.

@skeptrunedev
Copy link
Contributor

Hi @pjoshi30 I am really sorry that we have not yet gotten to this. We are in a hectic period of development trying to work with a couple of our enterprise customers and this requires a multi-hour review.

I promise that we will get to it before the end of the week.

@pjoshi30
Copy link

@skeptrunedev thank you! End of the week should work for us. We appreciate your help here and look forward to the feedback after your review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants