Skip to content
  1. Home
  2. AI tools
  3. LiteLLM

LiteLLM

Self-hosted gateway and SDK to call 100+ LLM APIs in OpenAI format

What it is

A Python SDK and a self-hosted proxy server that expose many LLM providers behind one OpenAI-style interface. The proxy acts as a central gateway for a team, so applications talk to one endpoint while providers are swapped behind it. For platform engineers standardising LLM access.

Good for

  • Put one API endpoint in front of many providers
  • Swap model vendors without changing app code
  • Run a shared LLM gateway for a team

Install or run

uv tool install 'litellm[proxy]'

Command as given in the project README. Read the repository before you run anything on your machine.

What you need

Python; API keys for the providers you route to

Worth knowingPart of the project is an enterprise tier; check which gateway features are in the open-source build.

Sources

The summary is ours, written from the README. Spotted an error? See how we work.

More for automation & ops

See the topic →
  • Hermes Agent

    NousResearch/hermes-agent

    Self-improving open-source agent with TUI, gateway, skills and cron

    ToolGitHub stars: 263k
  • Disk Cleanup plugin

    NousResearch/hermes-agent

    Auto-track and remove temp files created during Hermes sessions

    ToolGitHub stars: 263k
  • Google Meet plugin

    NousResearch/hermes-agent

    Join Google Meet, transcribe captions and follow up afterwards

    ToolGitHub stars: 263k
  • n8n

    n8n-io/n8n

    Self-hostable workflow automation with AI agent nodes

    ToolGitHub stars: 210k