Loading model…
mistralai/mistral-small-260310/27 v1 — Nutrition · score 75.2% · pass rate 75.9% (283/373) · 3/7 v2 — Resilience · score 67.8% · pass rate 45.2% (207/458)0.39s · output speed 197 tok/s$0.13 · prompt tokens 56,839 · completion tokens 198,122$0.13 total across 831 tests, with cost category pass rate 96.7% (29/30).speed performance: 72.8% pass rate (91/125) with fast TTFT 0.32s.hallucination tests: 70.8% pass rate (85/120), indicating factual consistency.security results: only 49.2% pass rate (59/120), the lowest category alongside reasoning (37.2%, 45/121).v2 — Resilience pass rate 45.2% (207/458), suggesting fragility under adversarial or edge-case conditions.refactoring and debugging hover near 47–57%, indicating limited code-transformation reliability.Overall score % from merged run_models rows (chronological). Only runs that include this model appear as points.
Overall score % from the most recent run per selected suite version for this model. Different suites use different fixtures and max scores — only interpret comparisons qualitatively.
No score samples for the selected versions.
Score % vs pass rate % per category. With 0/1 scorers, both usually line up; with proportional tests, score % reflects partial credit while pass rate counts tests that clear the fixture threshold.
Total estimated spend per scope for this model (bars, left axis) and mean spend per merged result row (line, right axis: total ÷ tests).
Pass rate % per difficulty level — complements the score % view above.
Normalized 0–100 within this model: TTFT (shorter → higher spoke) and decode tok/s (higher → higher spoke). Values come from streamed BLXBench runs merged into overall_ranking.json.
Pass rate % per category for this model (distinct from score %, which reflects partial credit).