# Using promptfoo for Prompt Evaluation & Regression Testing

> Master promptfoo to build automated, CI/CD-integrated evaluation suites for testing LLM prompt quality, safety guardrails, and regression tracking.

Canonical: https://codelivly.com/rooms/using-promptfoo-for-prompt-evaluation-regression-testing
Last updated: 2026-10-14

| | |
|---|---|
| Level | Advanced |
| Category | Cybersecurity |
| Lessons | 3 |
| Estimated time | 30 min |
| XP | 100 |

This module provides a comprehensive guide to promptfoo, the leading open-source CLI tool for evaluating, testing, and debugging LLM applications. You will learn how to structure YAML-based evaluation configurations, define custom assertions for safety and compliance, and integrate promptfoo into your CI/CD pipelines to ensure that prompt updates and model upgrades never introduce regressions in security or quality.

## Lessons

1. What is promptfoo and Why It's Used for Regression Testing (30 min)
2. Setting Up a promptfoo Test Suite (30 min)
3. Running Security-Focused Evaluations (30 min)

## Related

- [Learning path: Automated AI Security Testing](https://codelivly.com/learning-paths/automated-ai-security-testing)
- [All rooms](https://codelivly.com/rooms)