Skip to content

Skipping `get_spans` in GreedyCoverage aligners

Latest
Compare
Choose a tag to compare
@jogonba2 jogonba2 released this 25 Mar 09:08
· 1 commit to main since this release
73c57aa

This new version adds:

  • The possibility of skipping the get_spans step in GreedyCoverage aligners, when passing the spans already computed in token_to_chars by HuggingFace tokenizers. This result in faster execution of the algorithms.
  • Reran the benchmark to depict the time changes.
  • Extended the explanation of GreedyCoverage aligners in the README.