Skip to content
  1. Home
  2. AI tools
  3. Arize Phoenix

Arize Phoenix

Open-source LLM tracing and evaluation built on OpenTelemetry

What it is

An AI observability tool for experimenting with, evaluating and troubleshooting LLM applications. It collects traces through OpenTelemetry-based instrumentation and runs LLM-based evaluations, served from a local process started with pip or uvx. For engineers debugging agent and RAG behaviour during development.

Good for

  • Inspect traces from an agent during development
  • Score responses with LLM-based evaluators
  • Debug retrieval quality in a RAG pipeline

Install or run

pip install arize-phoenix

Command as given in the project README. Read the repository before you run anything on your machine.

What you need

Python; an LLM API key for LLM-based evaluations

Worth knowingThe vendor points managed production workloads to its separate commercial product.

Sources

The summary is ours, written from the README. Spotted an error? See how we work.

More for security & quality

See the topic →
  • Security Guidance plugin

    NousResearch/hermes-agent

    Warns when written code contains known-dangerous patterns

    ToolGitHub stars: 263k
  • security-guidance

    anthropics/claude-plugins-official

    Security warnings on edits plus LLM diff review

    ToolGitHub stars: 47k
  • Langfuse

    langfuse/langfuse

    Open-source tracing, evals and cost tracking for LLM applications

    ToolGitHub stars: 37k
  • Promptfoo

    promptfoo/promptfoo

    CLI for evaluating and red-teaming prompts, agents and RAG apps

    ToolGitHub stars: 27k