Skip to content
  1. Home
  2. Guides and documents
  3. a smol course

a smol course

Hands-on course on fine-tuning and aligning small language models

What it is

A practical Hugging Face course on adapting small language models to a specific use case, built around SmolLM3. Units cover instruction tuning, evaluation, preference alignment, vision language models and more, with exercises and a leaderboard. It is designed to run on modest local hardware without paid services.

Good for

  • Fine-tune a small model on your own data
  • Evaluate a model on a custom domain
  • Learn preference alignment methods

What you need

Python; a local GPU or Apple Silicon helps; free Hugging Face account

Worth knowingSome later units are still being released, and the course is due to move to Hugging Face Learn.

Sources

The summary is ours, written from the README. Spotted an error? See how we work.

More for learning

See the topic →
  • Generative AI for Beginners

    microsoft/generative-ai-for-beginners

    21-lesson course on building generative AI applications

    GuideGitHub stars: 123k
  • LLM Course

    mlabonne/llm-course

    Free roadmap and Colab notebooks for learning LLM engineering

    GuideGitHub stars: 85k
  • Prompt Engineering Guide

    dair-ai/Prompt-Engineering-Guide

    Reference guide to prompting techniques, papers and notebooks

    GuideGitHub stars: 80k
  • AI Agents for Beginners

    microsoft/ai-agents-for-beginners

    Lesson-based course on the fundamentals of building AI agents

    GuideGitHub stars: 80k