Question 1

How does SkillzBench measure whether a skill actually improves my agent's performance?

Accepted Answer

SkillzBench benchmarks every skill in a sandbox using the same model, running the task with and without the skill, then publishes the Lift in percentage points. Lift is always shown separately from Trust scores and ratings, so performance evidence is never mixed with opinion or commercial influence.

Question 2

What does SkillzBench do about MCP tool poisoning and vulnerable skills?

Accepted Answer

SkillzBench's Verify pillar pins every skill version to a commit SHA, then validates, license-checks, security-scans and quality-judges it. Each skill also gets a Trust score from 0 to 100 built from security, quality, license, maintenance and community signals, so you can filter out risky skills before they reach your agents.

Question 3

Can I control which skills each of my agents can see?

Accepted Answer

Yes — the Equip pillar provides one MCP server plus per-agent loadouts. You toggle skills and tools per agent, and the agent only sees what was chosen for it. That keeps tool descriptions tight and prevents the incorrect tool calls that come from bloated, ambiguous tool sets.

Question 4

Is SkillzBench available now, and what will it cost?

Accepted Answer

SkillzBench is pre-launch and actively being built; the waitlist and newsletter are live today. The planned pricing includes a generous free tier, a Pro tier (around $9–15/mo) for more agents and unlimited enabled skills, and a Teams tier (around $15–25/seat/mo) with org loadouts, allowlists and audit.

Question 5

How is SkillzBench different from just browsing the MCP registry or GitHub directly?

Accepted Answer

Registries and GitHub list skills; they don't prove them. SkillzBench continuously crawls and dedupes skills, pins versions to commit SHAs, security-scans and license-checks them, benchmarks Lift in a sandbox, and serves everything through one MCP server with per-agent loadouts — plus upstream change tracking that re-scans and re-benchmarks when maintainers update.

MCP Server Discovery for Data Analysts