Reports

About to onboard a new gateway — how do you know it's trustworthy? Test it yourself with gwbench: same model, your gateway vs OpenRouter vs others, run latency / stability / price / fake streaming / model substitution / long-context truncation in one go and produce a shareable report. Your key never leaves your machine. Below are public baseline reports and user-shared reports.

Generate Your OwnZero dependencies, Node ≥ 20, key stored only in environment variables

Compare "my gateway" against OpenRouter and AiHubMix on gemini-2.5-flash:

# With Node installed, after cloning the repo:
PROBE_KEY=your gateway's key OPENROUTER_API_KEY= AIHUBMIX_API_KEY= \
  npm run compare -- --model gemini-2.5-flash \
    --url https://my-gateway.com --name "My Gateway" --with openrouter,aihubmix
# → produces reports/gemini-2.5-flash-.html (self-contained, ready to share)

Want to publish to this gallery? Copy the generated report.json into web/reports/ and open a PR (or use node scripts/publish-report.mjs <report.json> to auto-archive + update the index). One-click upload is coming later.

Report ListPublic baseline + user-shared · filter by category

Classic model × gateway comparisons (marked Public Baseline): the price comparison comes from public pricing APIs — no key needed, already real data, refreshed as prices change; the speed / stability / behavior-fingerprint comparisons are generated by the platform's 6-hourly probing and fill in as each gateway's key is added. User-shared reports come from people who self-tested with gwbench and submitted their results.

Report
Download JSON