Question about FixedToken (insertion)? #73
-
Is the fixedToken inserted into the transformer decoding stream after aici detects that a specified character has been generated? To clarify, because I'm very unfamiliar with transformer terminology, I understand that the auto encoder/decoder generates n tokens, where the m (<n)th token is conditioned on the previous m-1 tokens. So does fixedToken actually insert a token into the m+1 generation stream, after it has detected tokens generated in the previous [0, m] range? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
You can choose where you want to insert fixed tokens. They behave exactly like regular prompts, except you can insert them after some tokens have been generated. |
Beta Was this translation helpful? Give feedback.
You can choose where you want to insert fixed tokens. They behave exactly like regular prompts, except you can insert them after some tokens have been generated.