BLXBenchBLXBench UI
blxbench

Benchmark

Misc

DocsOur TestsPassSponsor / Partnership
DocsOur TestsPassSponsor / Partnership
BLXBenchBLXBench UI
blxbench

Benchmark

Suite

Misc

DocsOur TestsPassSponsor / Partnership
DocsOur TestsPassSponsor / Partnership
  1. Home
  2. Our Tests
  3. 017 Make Traffic Light Bug 2
blxbench

Test fixture

017 Make Traffic Light Bug 2

Robloxv1 — Nutritionhardscorer: roblox_open_eval

Roblox OpenGameEval tasks. Special category: visible in breakdowns, excluded from Overall.

How it is scored

The model receives the prompt (and optional system message). The run uses scorer roblox_open_eval with the JSON configuration below. Pass/fail and partial credit are determined entirely by that scorer against the model output; no human grading.

User prompt
[Roblox OpenGameEval] I added the traffic light model to my game, but it's just stuck. The lights never turn on or change color.
Scorer config
{
  "input_script": "[embedded in CLI runner]",
  "upstream_path": "DebugEvals/017_make_traffic_light_bug_2.lua",
  "upstream_sha256": "f4d5d7f812ea067cc72311942fa3dfb4e2f553a039d112e163efbb07451a9c2a",
  "scenario_name": "017_make_traffic_light_bug_2",
  "place": "baseplate.rbxl",
  "eval_kind": "debug"
}
Run parameters

temperature

0

max_tokens

1

timeout (s)

900

type

scored

file

017_make_traffic_light_bug_2.json

← Previous017 Make Traffic Light Bug 1
|
Next →017 Make Traffic Light Bug 3

BLXBench

Community driven leaderboardPublic benchmark runner — run in your environment, share results with the community.

© 2026 BLXBench by bitslix.com

ProvenanceAggregated from user runs
Scope43 / 11 / 490
Latestrun_7730ad / 459 / $0.00
TermsPrivacy