Every release from kobold has me hyped one of the nicest engines that balances cutting edge features with ease of use and optimization. This is gonna be a great year for LocalLLaMA Hype :)

https://github.com/LostRuins/koboldcpp/releases

  • projectmoon
    link
    fedilink
    118 days ago

    @[email protected] I was using it like a year and a half ago. With the web UI that looks like it’s from 2008 lol. But I think at this point, I’d use it for the OpenAI compatible endpoint anyway.