This is so stupid. I have my AI server up right now in another tab and setup for creative writing. I currently have these tokens banned: 3221, 265, 28845, 382, 650, 28716, 16913, 1101
Those tokens correspond to specific word fragments and punctuation. Most are due to some sentence starting patterns I don’t like. I can ban any tokens and the model will not use them. All models have this functionality in the API for any user that actually knows what they are doing at a basic elementary level. Like the tokens for - – — are 28773, 764, and 1040, for my mixtral model.
This is so stupid. I have my AI server up right now in another tab and setup for creative writing. I currently have these tokens banned:
3221, 265, 28845, 382, 650, 28716, 16913, 1101Those tokens correspond to specific word fragments and punctuation. Most are due to some sentence starting patterns I don’t like. I can ban any tokens and the model will not use them. All models have this functionality in the API for any user that actually knows what they are doing at a basic elementary level. Like the tokens for
- – —are28773,764, and1040, for my mixtral model.