-
Notifications
You must be signed in to change notification settings - Fork 10.1k
Terminology
Brian edited this page May 21, 2024
·
4 revisions
-
BOS Token - Beginning of Sentence Token
-
EOS Token - End of Sentence Token
-
Token - short segments of symbols (that could typically make up a word)
-
Embeddings - Higher level token vectors representations of tokens
-
NIHS - Needle In a Hay Stack
-
NINS - Needle In Needle Stack
These are keywords in code that is not typically of importance to users.
- FA - Flash Attention
Useful information for users that doesn't fit into Readme.
- Home
- Feature Matrix
- GGML Tips & Tricks
- Chat Templating
- Metadata Override
- HuggingFace Model Card Metadata Interoperability Consideration
These are information useful for Maintainers and Developers which does not fit into code comments
Click on a badge to jump to workflow. This is here as a useful general view of all the actions so that we may notice quicker if main branch automation is broken and where.