Question 1

How does SkillzBench measure whether an MCP skill actually improves agent performance?

Accepted Answer

Every skill is benchmarked in a sandbox using the same model, tested both with and without the skill. The result is published as a Lift score in percentage points. Lift is always shown separately from ratings, and money never touches scores — so the number reflects measured performance, not marketing.

Question 2

What does the SkillzBench MCP server actually connect to?

Accepted Answer

SkillzBench provides one MCP server plus per-agent loadouts. You toggle skills and tools per agent, and the agent only sees what was chosen for it. This keeps tool surfaces lean and prevents agents from making excessive or irrelevant tool calls.

Question 3

How does SkillzBench handle MCP security risks like vulnerable skills?

Accepted Answer

Every skill version is pinned to a commit SHA and put through validation, license checks, and security scanning. A 0-100 trust score combines security, quality, license, maintenance, and community signals so you can assess risk before equipping anything. Note that launch scope covers instruction-only skills (SKILL.md plus text references); script-bearing skills are listed link-out only.

Question 4

When can I start using SkillzBench, and what will it cost?

Accepted Answer

SkillzBench is pre-launch and actively being built — the waitlist and newsletter are live now. Planned pricing includes a generous free tier, a Pro tier around $9-15/month for more agents and unlimited enabled skills, Teams around $15-25 per seat/month with org loadouts, allowlists, and audit, and a Creator tier around $5-10/month for verified authors.

Question 5

How is this different from just browsing the MCP Registry or GitHub for servers?

Accepted Answer

Registries and GitHub list what exists — SkillzBench tells you what works. It continuously crawls and dedupes skills, verifies each version against a commit SHA, security-scans and license-checks it, benchmarks it in a sandbox, and tracks upstream changes with re-scans and notifications. You get measured Lift and a trust score instead of star counts and readme claims.

MCP Server Discovery for Job Seekers