Benchmark run

run_fa781e

Started Apr 24, 2026, 11:03 PM · Recorded Apr 24, 2026, 11:06 PM · Ended Apr 24, 2026, 11:06 PM

14.3Blended scoreTests 7Models 1

Passed1

Failed6

Pass rate14.3%

Duration180.0s

Categories7

Models1

Est. cost (run)$0.02

Submitted byBitslix

Tokens (Σ results)535 / 6.6k

Models in this run

Per-model aggregates from overall_ranking.json for this run id.

ModelTestsPassScoreLatencyCost

deepseek/deepseek-v4-pro71/714.3%22.21s$0.02

No matching report.json under results/ — charts use ranking or summary only.

blxbench & discovery

Values are read from report.json when the benchmark wrote them.

Discovery

Limited — up to 1 test(s) per category

blxbench argv

tui

Category performance (this run)

Score % vs mean latency where samples exist. Built from per-test rows in report.json when available.

By difficulty level

Pass vs fail

Latency distribution

Per-test latency (seconds), successful timings only.

Streaming shape (radar)

Normalized TTFT (inverted) vs decode tok/s per category for this run.

Tests per category

All task results

Per-test rows from report.json → results — by category (collapsed by default), then by difficulty. COMPL from details when present. The Visual column is omitted when no test in this run has a details.visual score. Judge: verdict and overall (0–100) from judge_validation / validation_model for coding/UI (hover for summary and subscores). No HTML or screenshots in this table.

7 tasks in 7 categories · Grouped by category, then by difficulty; row order within each table matchesreport.json results (benchmark execution order)