Evals in Production with Claude — From Vibes to Auditable Metrics
Learn how to build a robust evaluation system for your Claude API applications: golden sets, unbiased LLM-as-judge, evals for RAG and agents, regression tests in CI, A/B testing in production, and a 30-day plan to roll out evals across your team. Move from 'it seems to work' to auditable, comparable metrics that gate every release.
Who is this course for?
Designed for professionals who want to master AI without prior experience
No technical experience
No coding or prior AI knowledge required
Immediate results
Apply what you learn from the very first lesson to your real work
At your own pace
Access anytime, from any device, no fixed schedules
Certificate included
Get a verifiable certificate upon course completion
Course curriculum
Everything you'll learn, lesson by lesson.
- 1 Evals: the exam your LLM takes before every deploy Quiz
- 2 The golden set: your board exam for LLMs Quiz
- 3 Three judge types for three task types Quiz
- 4 Rubrics: the recipe so two judges give the same grade Quiz
- 1 From golden set to runnable pipeline in 30 minutes Quiz
- 2 The fair judge: PESO against LLM-judge biases Quiz
- 3 RAG and Tool Use: two circuits to evaluate separately Quiz
- 4 TRACE: the framework to evaluate agents that act Quiz
- 1 GitHub Actions + Claude evals: the smart merge Quiz
- 2 Online A/B with a safety net: never to production blind Quiz
- 3 Cheap evals: pay just enough for the confidence they give you Quiz
- 4 From 'we don't measure' to 'evals in CI' in 4 weeks Quiz
This is how you'll learn
A glimpse at the first lessons of the course
Evals Fundamentals
Lesson 1: Evals: the exam your LLM takes before every deploy
Lesson 2: The golden set: your board exam for LLMs
Lesson 3: Three judge types for three task types
And much more practical content waiting for you...
With interactive quizzes and real challenges.
Unlock all lessons
Start nowChoose your plan
From free to unlimited lifetime access. No fine print.
Free
- 2 free Fundamentals courses included
- Quizzes and hands-on challenges
- No credit card required
Individual
- Buy individual courses
- Immediate and permanent access
- No subscription
Pro Annual
- All courses included
- Save 50% vs monthly
- 24/7 AI assistant
- Priority support
Lifetime
- Lifetime access
- All current and future courses
- 24/7 AI assistant
- No recurring payments
* Prices shown in USD are approximate. Final charge will be in euros (EUR) at the current exchange rate.
Frequently Asked Questions
We answer your questions before you start
No, our courses are designed from scratch for absolute beginners.
Each course takes just a few hours, at your own pace. No pressure.
Step-by-step lessons, interactive quizzes, hands-on challenges and a certificate of completion.
Yes, all courses are optimised for mobile, tablet and desktop.
Yes, upon completing the course you receive a verifiable certificate you can share on LinkedIn and your resume.
Yes, we offer both individual courses and a one-time Lifetime plan with access to all current and future courses.
Start today
Lifetime access to this course for €4.99. No subscription, no surprises.
Start today — 2 free courses with registration, no commitment