Flags for KoboldCpp to enable tool-calling?

#3
by Braidwalkers - opened

I am absolutely LOVING this model! It reminds me a lot of ChatGPT-4o. A lot. And with it uncensored, I no longer get the, "As and AI, I can't feel..."
Thank you SO much!

I know this model supports tool calling, but I need the flags for KoboldCpp. Neither vLLM nor SGLang flags work.
Do you know them or can you point me to definitive flags for KoboldCpp to enable all the tools?

Sign up or log in to comment