Agent skill

promptfoo-evals

Write, refine, run, and QA non-redteam promptfoo eval suites after the target or provider already works: prompts, vars, test cases, assertions, model-graded rubrics, transforms, datasets, output exports, filters, and CI gates. Use for regression tests and eval-suite authoring. Do not use for connecting a new target/provider, mapping HTTP requests or auth, smoke-testing an endpoint, or redteam plugin/strategy setup; use `promptfoo-provider-setup` for connection work instead.

★ 24,743 stars MIT promptfoo/promptfoo

Install this skill

This command installs the skill into the portable ~/.agents/skills directory. The homepage installer can generate the native path for your specific agent.

mkdir -p $HOME/.agents/skills/'promptfoo-evals' && curl -fsSL 'https://raw.githubusercontent.com/promptfoo/promptfoo/HEAD/plugins/promptfoo/skills/promptfoo-evals/SKILL.md' -o $HOME/.agents/skills/'promptfoo-evals'/SKILL.md

Skill details

Repository
promptfoo/promptfoo
SKILL.md path
plugins/promptfoo/skills/promptfoo-evals/SKILL.md
Author
promptfoo
Tags
agent-skill