Skip to content
  1. Home
  2. AI tools
  3. Ollama

Ollama

Download and run open LLMs locally behind a simple CLI and API

What it is

A runtime that downloads and runs open-weight models on your own machine and serves them over a local HTTP API. It has a CLI, a Docker image and Python and JavaScript client libraries, and can hand a local model to coding agents such as Claude Code or Codex. For anyone who wants local models without manual setup.

Good for

  • Run an open model on a laptop
  • Serve a local LLM API for other apps
  • Point a coding agent at a local model

Install or run

curl -fsSL https://ollama.com/install.sh | sh

Command as given in the project README. Read the repository before you run anything on your machine.

What you need

Enough RAM or VRAM for the chosen model

Worth knowingUsable model size and speed depend heavily on your hardware; the README also promotes cloud-hosted models.

Sources

The summary is ours, written from the README. Spotted an error? See how we work.

More for productivity & knowledge

See the topic →
  • Open WebUI

    open-webui/open-webui

    Self-hosted chat interface for Ollama and OpenAI-compatible APIs

    ToolGitHub stars: 159k
  • llama.cpp

    ggml-org/llama.cpp

    C/C++ LLM inference engine with CLI and OpenAI-compatible server

    ToolGitHub stars: 135k
  • Claude-Mem

    thedotmack/claude-mem

    Records what your agent did and loads a summary into later sessions

    ToolGitHub stars: 117k
  • AnythingLLM

    Mintplex-Labs/anything-llm

    Desktop and Docker app for chatting with your documents via any LLM

    ToolGitHub stars: 68k