Question 1

What exactly is benchmark-as-a-service from SkillzBench?

Accepted Answer

It's priority access to SkillzBench's benchmark runs. Instead of waiting in the standard queue, your candidate AI agent skills get tested in our sandbox with the same model, with and without the skill, and you receive the published Lift in percentage points along with the full verification workup — commit SHA pinning, security scan, license check and quality judgment.

Question 2

Is SkillzBench live right now?

Accepted Answer

SkillzBench is pre-launch and actively being built. The waitlist and newsletter are live today, and benchmarking, scanning and the MCP server are what we're building and will offer. We don't publish live skill counts or benchmark results yet — join the waitlist to be first in line for benchmark-as-a-service priority runs.

Question 3

How does SkillzBench handle security for skills used in education settings?

Accepted Answer

Every skill is pinned to a commit SHA, validated, license-checked, security-scanned and quality-judged before receiving a Trust score from 0-100 built on security, quality, license, maintenance and community signals. This matters because published research found roughly of agent skills carry at least one vulnerability — and educators already face tight privacy reviews and credibility concerns with vendor content.

Question 4

When can I get priority benchmark runs for my skills?

Accepted Answer

Join the waitlist now and you'll be positioned for early access as benchmark-as-a-service comes online. Because the product is pre-launch, exact timing depends on our build roadmap — waitlist subscribers get notified first as verification, benchmarking and the MCP server roll out.

Question 5

How is this different from just reading a skill's README or GitHub stars?

Accepted Answer

READMEs and star counts tell you nothing about whether a skill actually improves agent performance or introduces risk. SkillzBench tests every skill in a sandbox with the same model, with and without the skill, and publishes the Lift in percentage points — always shown separately from ratings, with money never touching scores. We also continuously track upstream changes and re-benchmark, so a skill that was safe when you adopted it gets re-scanned if it changes.

Benchmark-as-a-Service for Teachers