Skill profile

promptfoo-evals

Write, refine, run, and QA promptfoo evaluation suites: promptfooconfig.yaml, prompts, providers,...

What this skill does for you

Write, refine, run, and QA promptfoo evaluation suites: promptfooconfig.yaml, prompts, providers, vars, tests, assertions, model-graded rubrics, transforms, datasets, exports, and CI gates. Use for non-redteam eval coverage, regression tests, or new eval matrices. Do not use for adversarial redteam plugin or strategy setup.

Quoted from the skill description in the pinned source

Who made it

Publisherpromptfoo

Repositorypromptfoo

Installs294as of Sep 27, 2026

Use it with Edge

Set up Edge for me: read getedge.cc/SKILL.md and follow it. Then use Edge to load the promptfoo-evals skill from promptfoo/promptfoo.

Paste it into Claude, ChatGPT, Codex or Cursor.

Or read the skill source first.

Security evidence

Security state at 2026-09-30: reviewed. State definitions. This records static evidence for this revision; live load eligibility is checked again.

3 static scans, 0 counted findings. The listed scanners recorded the results shown for this package revision.

Scanner	Date	Result
Edge static checks	2026-09-27	Pass
Cisco skill-scanner	2026-09-27	Pass
Semgrep Edge rules	2026-09-27	Pass

Static scans check the code, not how well the skill works.

Scanner scope, raw findings and mirrored provider records

Edge static checks (Edge-run): edge-static/1.0.1. Scope: Static patterns for remote execution, credentials with network sends, obfuscation, prompt overrides, hidden Unicode, binaries and persistence. Revision: fdb5e6485d31bda36b19e6da8d0830d7af331d60. Raw findings: . Counted findings: .

Cisco skill-scanner (Edge-run): cisco-skill-scanner/2.1.0. Scope: Local static, YARA, pipeline and behavioral analyzers; no LLM or AI Defense analysis. Revision: fdb5e6485d31bda36b19e6da8d0830d7af331d60. Raw findings: 1. Counted findings: .

Semgrep Edge rules (Edge-run): semgrep/1.178.0+edge-rules.c15016a36fd3+offline-v1. Scope: Six Edge-authored static rules with Semgrep CE; offline execution and metrics disabled. Semgrep-maintained rules excluded. Revision: fdb5e6485d31bda36b19e6da8d0830d7af331d60. Raw findings: . Counted findings: .

Source and licence

Repository: https://github.com/promptfoo/promptfoo
Pinned skill file: View source at revision
Revision: fdb5e6485d31bda36b19e6da8d0830d7af331d60
Package hash: sha256:1fd0c790bcbc610e4210d2347a958d0825de9b8065bb17e836e176cb6c4e03f2
Licence: MIT