Skip to content
Main Site News Console

Why AnythingLLM Is Moving from Ollama to Lemonade and llama.cpp

· Reddit · r/LocalLLaMA Translated
Reddit

Thrilled to see our Lemonade embedded SDK being put to work in real-world scenarios!

Top Discussions

tcarambat (⬆116): Tim from AnythingLLM here! Glad this migration is finally behind us. I was completely fed up with Ollama. Given that Lemonade also supports sd.cpp, kokoro, and everything else, hopefully we can get full feature support in place so folks can just use all these capabilities without juggling a mess of third-party apps—just using standard GGUF models and the like. So glad this is wrapped up, and we’re also planning to merge lemonade + llamacpp upstream into the Docker image, since we… NoFunk (⬆20): I installed AnythingLLM once, saw it was using Ollama, and immediately uninstalled it. Now I can reinstall and give it a proper spin. Thanks! seamonn (⬆158): Because Ollama sucks? starkruzr (⬆88): Pretty much. “TL;DR: Nobody should ever use Ollama for anything, under any circumstances. Thank you, good night.” MrSkullking (⬆77): I’m still surprised Ollama is as popular as it is. Is it purely because it had the best name recognition and marketing back when local LLMs were first taking off? toluwalase (⬆34): Probably. Back when I had no clue what I was doing, it was the first tool I downloaded. Eventually, I switched to Llama. tcarambat (⬆49): Honestly, that’s the sole reason we went with it originally. While llamacpp has always been the functional backbone for local inference, Ollama was just easier to manage back then, and philosophically that seemed to be their main focus. Obviously, that turned out not to be the case, making this a long-overdue item on our backlog. Factoring in support across Windows, Mac, Linux, and every permutation of architecture and GPU, it really was just more convenient than raw llamacpp at the time. But yeah—long ago they were just easier to use; after that, it was pure SEO and GitHub hype carrying them. paryska99 (⬆34): I think this is a fantastic move. Ollama is nowhere near being a professional tool.