Skip to content
  1. Home
  2. AI tools
  3. AnythingLLM

AnythingLLM

Desktop and Docker app for chatting with your documents via any LLM

What it is

An application for chatting with your own documents and running agents, available as a desktop app or a multi-user Docker deployment. You connect a local or cloud LLM, ingest files, and it handles parsing and vector storage. For individuals and small teams wanting a private document assistant without building a RAG stack.

Good for

  • Ask questions across a folder of documents
  • Run a private multi-user document chatbot
  • Pair a local model with document retrieval

What you need

The desktop installer or Docker; a local or cloud LLM

Worth knowingSends anonymous usage telemetry by default according to the README; check the opt-out before sensitive use.

Sources

The summary is ours, written from the README. Spotted an error? See how we work.

More for productivity & knowledge

See the topic →
  • Ollama

    ollama/ollama

    Download and run open LLMs locally behind a simple CLI and API

    ToolGitHub stars: 187k
  • Open WebUI

    open-webui/open-webui

    Self-hosted chat interface for Ollama and OpenAI-compatible APIs

    ToolGitHub stars: 159k
  • llama.cpp

    ggml-org/llama.cpp

    C/C++ LLM inference engine with CLI and OpenAI-compatible server

    ToolGitHub stars: 135k
  • Claude-Mem

    thedotmack/claude-mem

    Records what your agent did and loads a summary into later sessions

    ToolGitHub stars: 117k