Build Your Own LLM
Learn the full LLM pipeline through compact lessons and executable labs.
Learn to measure, test, and improve AI systems through hands-on labs: metrics, benchmarks, unit tests for LLMs, adversarial testing, regression suites, and production monitoring.
Module 1: Foundations — Why Evaluation Matters
3 lessons
Lesson in Module 1: Foundations — Why Evaluation Matters
Lesson in Module 1: Foundations — Why Evaluation Matters
Lesson in Module 1: Foundations — Why Evaluation Matters
Module 2: Text & Generation Metrics
4 lessons
Lesson in Module 2: Text & Generation Metrics
Lesson in Module 2: Text & Generation Metrics
Lesson in Module 2: Text & Generation Metrics
Lesson in Module 2: Text & Generation Metrics
Module 3: LLM-as-Judge
3 lessons
Module 4: Test Suites & Regression Testing
4 lessons
Lesson in Module 4: Test Suites & Regression Testing
Lesson in Module 4: Test Suites & Regression Testing
Lesson in Module 4: Test Suites & Regression Testing
Lesson in Module 4: Test Suites & Regression Testing
Module 5: Adversarial & Robustness Testing
3 lessons