018 Weather Machine

The model receives the prompt (and optional system message). The run uses scorer roblox_open_eval with the JSON configuration below. Pass/fail and partial credit are determined entirely by that scorer against the model output; no human grading.

[Roblox OpenGameEval] Create a 'WeatherMachine' part that, when activated, cycles through sunny, rainy, and foggy conditions every 3 seconds, visually affecting the entire game world.

{
  "input_script": "[embedded in CLI runner]",
  "upstream_path": "Evals/018_weather_machine.lua",
  "upstream_sha256": "0758b53bf6585476f5ef62a91ddab588f8227377bb160966a216933c41dc8d81",
  "scenario_name": "018_weather_machine",
  "place": "baseplate.rbxl",
  "eval_kind": "codegen"
}