Affaan MustafaTrading lead at Jump Trading; ECC 290k+ stars6,200 installs on skills.shEval Harness
Eval-driven development (EDD) framework for AI coding sessions : define capability and regression...
Use Edge to load the skill eval-harness from affaan-m/ecc for my task. If Edge is not set up, read getedge.cc/SKILL.md and ask me first.
2 static scans, 0 counted findings.
Edge checks it again each time your agent loads it.
From the affaan-m public repository. Edge did not write or edit this skill.
What it does
Eval-driven development (EDD) framework for AI coding sessions : define capability and regression evals before coding, grade with code-based, model-based, rule, or human graders, and track pass@k and pass^k reliability. Use when defining pass/fail criteria for agent tasks, measuring agent reliability, building regression suites for prompt or agent changes, or benchmarking across model versions.
Why Affaan Mustafa
Compute Trading Lead at Jump Trading. Each fact links its public source.
- Role at Jump Trading
His GitHub bio says Compute Trading Lead at Jump Trading, previously founding The Agentic Desk.
GitHub profile - Hugely starred agent harness repo
ECC has 290k+ GitHub stars.
GitHub repo - Security tool with traction
agentshield has 1.3k+ GitHub stars.
GitHub repo
Public sources, checked Oct 26, 2026.
How it works
- 1Copy
Try for free gives you one prompt.
- 2Paste
Paste it into Claude Code, Codex or Cursor.
- 3Ask
Ask for the outcome. Your agent loads Eval Harness.
Related skills
Build the evaluation harness that gates every fine-tuning run — golden sets, per-failure-mode graders, judge calibration, and base-model baselines. Use when starting a fine-tuning effort, when converting traces into an e
Improve AI application with evaluation-driven development. Define eval criteria, instrument the application, build golden datasets, observe and evaluate application runs, analyze results, and produce a concrete action pl
Write, refine, run, and QA promptfoo evaluation suites: promptfooconfig.yaml, prompts, providers, vars, tests, assertions, model-graded rubrics, transforms, datasets, exports, and CI gates. Use for non-redteam eval cover
Tests/benchmarks a third-party LLM endpoint (OpenAI- or Anthropic-compatible): availability, fidelity, speed, concurrency, protocol compliance, quality regression. Use before hand-rolling a curl loop, when onboarding a p
Write the test first, watch it fail, write minimal code to pass
Scaffolds eval.yaml evaluation specs for agent skills in the dotnet/skills repository. Use when creating skill tests, writing evaluation stimuli, defining graders and rubrics, sizing an eval for statistical power, or set
No evidence record yet
No measured run with and without this skill yet, so this page makes no performance claim. 2 static scans, 0 counted findings. Security state at 2026-11-17: reviewed. Static scans check the code, not how well the skill works.
State definitionsSkill details
Security scansReviewed
2 static scans, 0 counted findings. Security state at 2026-11-17: reviewed. Edge checks it again each time your agent loads it.
Edge static checks (Edge-run): edge-static/1.0.2. Scope: Static patterns for remote execution, credentials with network sends, obfuscation, prompt overrides, hidden Unicode, binaries and persistence. Raw findings: not supplied.
Edge committed-secret checks (Edge-run): edge-secrets/1.0.0. Scope: Credentials committed in the skill's files (values never shown). Raw findings: not supplied.
Socket (skills.sh mirror): Version unavailable. Scope: Not supplied by the mirrored record. Raw findings: not supplied.
Snyk (skills.sh mirror): Version unavailable. Scope: Not supplied by the mirrored record. Raw findings: not supplied.
- Edge static checks
- Pass · 0 counted findings · 2026-11-17
- Edge committed-secret checks
- Pass · 0 counted findings · 2026-11-17
Creator, source & licenceaffaan-m
From the affaan-m public repository. Edge did not write or edit this skill.
- Repository
- affaan-m/ecc
- Skill file
- View source at revision
- Revision
- d3b8a3e908904e242ed2dbe66af62cca71131419
- Package hash
- sha256:3a12d23c17d7526505fb1e1a606b769b8cf1368d438ab846a1ff4a2b8f97527f
- Licence
- MIT
- Description
- Eval-driven development (EDD) framework for AI coding sessions : define capability and regression evals before coding, grade with code-based, model-based, rule, or human graders, and track pass@k and pass^k reliability. Use when defining pass/fail criteria for agent tasks, measuring agent reliability, building regression suites for prompt or agent changes, or benchmarking across model versions.
Quoted from the skill’s own description
Read skill files1 file
1 file, 8.5 KB at revision d3b8a3e90890.
Questions about Eval Harness
What does Eval Harness do?
Eval-driven development (EDD) framework for AI coding sessions : define capability and regression... Published by Affaan Mustafa (affaan-m/ecc).
Is Eval Harness safe to use?
Edge security state: Reviewed (2 Edge-run static scans, scanned Nov 17, 2026). The Evidence tab shows the scan.
How do I use Eval Harness in Claude Code, Codex or Cursor?
Click Try for free, pick your agent and follow its one step. Edge is free, with no Edge account.