Tools / product

llama.cpp

MIT LLM inference in C/C++. A local runner you compile and host, not a chat UI.

URL

https://github.com/ggml-org/llama.cpp

Collection

AI & Agents

Language

C++

License

MIT License

Stars

131,637

Open source

Yes

llmlocal-aiself-hostedopen-source

Ranked on

• Best open-source Local LLM runners