Search results

please help me

Status: Open.

#38 In daulet/tokenizers;

· gosundy opened on May 26, 2025

can't load a tokneizer from json file, the error is "invaild argument"

Status: Open.

#36 In daulet/tokenizers;

· YuzheZhou2000 opened on Apr 9, 2025

Memory Leak via Cgo in Encode/Decode with Large Inputs (v1.20.2)

Status: Open.

#35 In daulet/tokenizers;

· Nav31 opened on Mar 27, 2025

<code>failed to cast tokenizer</code>

Status: Open.

#32 In daulet/tokenizers;

· frederickmannings opened on Jan 17, 2025

Panic when execute tk.Encode

Status: Open.

#31 In daulet/tokenizers;

· qihuang0 opened on Dec 3, 2024

Can padding and/or Truncation be overridden using the library

Status: Open.

#30 In daulet/tokenizers;

· rmrbytes opened on Nov 29, 2024

Can tokenizers.fromPretrained cache directory be specified

Status: Open.

#29 In daulet/tokenizers;

· rmrbytes opened on Nov 16, 2024

Performance regression

Status: Open.

#14 In daulet/tokenizers;

· daulet opened on Nov 19, 2023