Moved the creation of the sorted vocabulary in "build_tokenizer()"#328

rdentato wants to merge 5 commits intokarpathy:masterkarpathy/llama2.c:masterfrom

rdentato:patch-less-qsort-in-encoderdentato/llama2.c:patch-less-qsort-in-encodeCopy head branch name to clipboard