Skip to content
  1. Home
  2. Guides and documents
  3. OpenAI Cookbook: Evaluation Examples

OpenAI Cookbook: Evaluation Examples

Worked examples for evaluating prompts, RAG and SQL generation

What it is

The evaluation folder of the OpenAI Cookbook. It includes a written guide to the evaluation flywheel for making prompts hold up across inputs, a getting-started notebook for OpenAI Evals, and examples for scoring summaries, SQL generation and RAG pipelines, plus notes on moving from OpenAI Evals to promptfoo.

Good for

  • Set up an evaluation loop for a prompt
  • Score summarisation quality
  • Evaluate text-to-SQL output

What you need

OpenAI API key for the notebooks

Worth knowingTied to OpenAI tooling; several notebooks predate current models and APIs.

Sources

The summary is ours, written from the README. Spotted an error? See how we work.

More for security & quality

See the topic →
  • Trail of Bits Claude Code Config

    trailofbits/claude-code-config

    Security firm's documented Claude Code defaults and sandboxing setup

    GuideGitHub stars: 2.1k
  • Awesome MCP Security

    Puliczek/awesome-mcp-security

    Reading list on Model Context Protocol security risks and tools

    GuideGitHub stars: 747
  • Awesome Prompt Injection

    Joe-B-Security/awesome-prompt-injection

    Reading list on prompt injection: articles, papers, tools and CTFs

    GuideGitHub stars: 721
  • OWASP Top 10 for Large Language Model Applications

    GenAI-Security-Project/GenAI-LLM-Top10

    Source repository for OWASP's top ten risks in LLM applications

    GuideGitHub stars: 168