Open
Description
tokenize_document
is PyTorch specific (it uses a transformers
tokenizer), so it will be removed from pie-modules
(see ArneBinder/pie-modules#187).
more context: ArneBinder/pie-core#17
requires pie-modules
release including ArneBinder/pie-modules#187
Metadata
Metadata
Assignees
Labels
No labels