Open
Description
In tests, or when wanting to just debug something quickly, the process hangs on import evaluate
.
I benchmarked it on two devices:
python -c "import time; start = time.time(); import datasets; print(f'datasets: {time.time() - start:.3f}s')"
python -c "import time; start = time.time(); import transformers; print(f'transformers: {time.time() - start:.3f}s')"
python -c "import time; start = time.time(); import evaluate; print(f'evaluate: {time.time() - start:.3f}s')"
Linux server:
datasets: 0.724s
transformers: 1.527s
evaluate: 3.438s
macOS:
datasets: 1.076s
transformers: 1.072s
evaluate: 8.987s
9 seconds on my mac (m1 pro) is very slow just for the import. can you please look at why this is the case?
Metadata
Metadata
Assignees
Labels
No labels