Reason-Rc-Thundering-Herd

The model receives the prompt (and optional system message). The run uses scorer rubric_json_metrics with the JSON configuration below. Pass/fail and partial credit are determined entirely by that scorer against the model output; no human grading.

Return JSON only with keys answer, evidence, constraints. After a full cache flush, 1000 concurrent requests arrive simultaneously and all miss the cache. They all hit the database at the same time. Response times spike dramatically. What is the root cause?

{
  "metrics": {
    "accuracy": {
      "checks": [
        {
          "contains": [
            "thundering herd"
          ]
        },
        {
          "contains": [
            "cache stampede"
          ]
        },
        {
          "contains": [
            "simultaneous"
          ]
        }
      ]
    },
    "evidence": {
      "checks": [
        {
          "contains": [
            "cache flush"
          ]
        },
        {
          "contains": [
            "1000"
          ]
        },
        {
          "contains": [
            "cache miss"
          ]
        }
      ]
    },
    "constraint": {
      "checks": [
        {
          "contains": [
            "probabilistic"
          ]
        },
        {
          "contains": [
            "cache lock"
          ]
        },
        {
          "contains": [
            "warm-up"
          ]
        }
      ]
    }
  }
}