Question 1

How does SkillzBench measure whether an SKILL.md package actually improves agent performance?

Accepted Answer

SkillzBench benchmarks every skill in a sandbox using the same model, running tasks with and without the skill, and publishes the resulting Lift in percentage points. Lift is always shown separately from ratings so you can see measured impact distinct from community or quality signals.

Question 2

What security risks should I worry about when installing agent skills from GitHub?

Accepted Answer

Published research found roughly 26% of skills carry at least one vulnerability, so unvetted skills are a real attack vector. SkillzBench addresses this with security scans, license checks, and quality judging on every skill, and pins each version to a commit SHA so you always know exactly what code you're running.

Question 3

Does SkillzBench support script-bearing skills or only instruction-only SKILL.md packages?

Accepted Answer

Launch scope covers instruction-only skills — SKILL.md plus text references. Script-bearing skills are listed link-out only, so you can discover them but SkillzBench won't install or execute their scripts at launch.

Question 4

When can I start using SkillzBench, and how do I get early access?

Accepted Answer

SkillzBench is pre-launch and actively being built — the waitlist and newsletter are live now, but the product isn't public yet. Join the waitlist to be notified as the Discover, Verify, Benchmark, Equip, and Stay-current pillars come online.

Question 5

How is SkillzBench different from just browsing GitHub for agent skills?

Accepted Answer

GitHub shows you stars; SkillzBench shows you evidence. It continuously crawls and dedupes skills, pins versions to commit SHAs, security-scans and license-checks each one, benchmarks Lift in a same-model sandbox, assigns a 0-100 trust score that money can't influence, and lets you equip verified skills through one MCP server with per-agent loadouts — then keeps tracking upstream changes for you.

Custom Skill Development for Designers