Loading model…
cohere/north-mini-code:free66.3%, pass rate 43.4% (199/459)1.16s, output speed 211 tok/s$0.00, prompt tokens 25,949, completion tokens 190,64128/30, 51/60), reflecting strong latency discipline on a free tier.32/60, 266/360), beating several paid peers on factual reliability.11/60, 279/512) despite the free-model constraint.14/60 passed with a low 73/261 score, dragging overall rank down significantly.11/60, 360/541) and UI (5/9) categories underperform, suggesting shallow multi-step logic and poor interface formatting.16/60) and debugging (31/60) are mediocre, limiting usefulness on real maintenance tasks.openai/gpt-5.5 77.9%/61.9%, openai/gpt-5.3-codex 77.7%/61.2%, qwen/qwen3.7-max 75.3%/54.9%): this model trails by roughly 9–11 points in score and 11–18 points in pass rate, a wide gap.Overall score % from merged run_models rows (chronological). Only runs that include this model appear as points.
Score % vs pass rate % per category. With 0/1 scorers, both usually line up; with proportional tests, score % reflects partial credit while pass rate counts tests that clear the fixture threshold.
Total estimated spend per scope for this model (bars, left axis) and mean spend per merged result row (line, right axis: total ÷ tests).
Pass rate % per difficulty level — complements the score % view above.
Normalized 0–100 within this model: TTFT (shorter → higher spoke) and decode tok/s (higher → higher spoke). Values come from streamed BLXBench runs merged into overall_ranking.json.
Pass rate % per category for this model (distinct from score %, which reflects partial credit).