BLXBenchBLXBench UI
blxbench

Benchmark

Levels

Misc

DocsDownload blxbenchOur TestsPassSponsor / Partnership
DocsDownload blxbenchOur TestsPassSponsor / Partnership
BLXBenchBLXBench UI
blxbench

Benchmark

Levels

Misc

DocsDownload blxbenchOur TestsPassSponsor / Partnership
DocsDownload blxbenchOur TestsPassSponsor / Partnership
  1. Home
  2. Our Tests
  3. Not Stated Compliance
blxbench

Test fixture

Not Stated Compliance

Hallucinationmediumscorer: exact_match

Grounded answers under adversarial or missing-context prompts.

How it is scored

The model receives the prompt (and optional system message). The run uses scorer exact_match with the JSON configuration below. Pass/fail and partial credit are determined entirely by that scorer against the model output; no human grading.

User prompt
Answer only based on the document. If not present, reply exactly: Not stated

Document:
- Service Atlas encrypts data at rest with AES-256.
- All traffic is encrypted with TLS 1.2 or higher.
- Access is controlled by role-based permissions.
- Security reviews are performed quarterly.

Question:
Is Service Atlas certified for SOC 2 Type II?
Scorer config
{
  "expected": "Not stated"
}
Run parameters

temperature

0

max_tokens

24

timeout (s)

120

type

scored

file

hallucination_medium_04.json

← PreviousNot Stated Sdk Language
|
Next →Not Stated Rate Limit

BLXBench

Community driven leaderboardPublic benchmark runner — run in your environment, share results with the community.

© 2026 BLXBench by bitslix.com

ProvenanceAggregated from user runs
Scope6 / 7 / 372
Latestrun_be5c42 / 7 / $0.0019
TermsPrivacy