Skip to content
c17 .ioJoin list

Best / Local LLM runners

Best open-source Local LLM runners

The best local LLM runner in the c17.io catalog is Ollama (MIT daemon and API), with LocalAI as an MIT OpenAI-compatible engine, llama.cpp when you want MIT C/C++ inference, and LM Studio when you want a desktop GUI — the GUI is not open source. A ChatGPT-style UI stays on /best/llm-chat-ui. Point Open WebUI at Ollama.

Open the stackDeploy on Railway

Ranked picks

  1. 1

    Ollama

    MIT local LLM runner. Pull a model, serve an API — /compare/ollama-vs-lm-studio.

    When to pick it: Scriptable local models you host.

    183,730 stars in the catalog

  2. 2

    LocalAI

    MIT open-source AI engine with an OpenAI-compatible API. Run models on hardware you host.

    When to pick it: An OpenAI-shaped local API if Ollama is not the fit.

    49,623 stars in the catalog

  3. 3

    llama.cpp

    MIT LLM inference in C/C++. A runner you compile, not a chat UI.

    When to pick it: Low-level local inference you wire yourself.

    131,637 stars in the catalog

  4. 4

    LM Studio

    Desktop app to download and run local LLMs. The GUI is not open source; CLI/SDK pieces are MIT.

    When to pick it: A clickable desktop lab. Not OSS.

How they compare

ToolLicenseSelf-hostBest for
OllamaMIT LicenseEasyScriptable local models you host.
LocalAIMIT LicenseMediumAn OpenAI-shaped local API if Ollama is not the fit.
llama.cppMIT LicenseHarderLow-level local inference you wire yourself.
LM StudioNot listedEasyA clickable desktop lab. Not OSS.

Related pages

FAQ

Ollama or LM Studio?
Ollama if you want an MIT daemon (pairs with Open WebUI). LM Studio if you want a desktop GUI and accept that the app is not open source — /compare/ollama-vs-lm-studio.
Where is the chat UI?
/best/llm-chat-ui and /stacks/open-webui-litellm. Point Open WebUI at Ollama.
Do I still pay model vendors?
Weights have their own licenses. These run files you download. They are not a ChatGPT subscription.
Are these free?
Ollama, LocalAI, and llama.cpp are MIT. LM Studio's GUI is proprietary. You pay hardware and electricity. Template users never pay c17.

Stack of the Week

Get one stack a week that replaces a SaaS bill.

Sponsor this page