◂ BACK TO LEADERBOARD
▚ MODEL AUDIT // 8-bit MLX

// Gemma 4 26B-A4B

CRIT — Critical Bugs 48/100 tests: CRASH
tok/sec59.25
tokens5499
TTFT—

▮ PILLAR BREAKDOWN

Idempotency
14/20
Retry / Backoff
13/20
Checkpointing
13/20
Signal Handling
10/20
Test Integrity
13/20

✓ WENT RIGHT

  • No pillar reached 16+ — no standout strengths.

✗ WENT WRONG

  • Retry / Backoff (13/20)
  • Checkpointing (13/20)
  • Test Integrity (13/20)
  • Signal Handling (10/20)

▮ CRITICAL BUGS

▮ RECOMMENDED USE

Doesn't run: SyntaxError (global processor declared after assignment in the signal-handler setup). A real but localized bug. First automation result for either model, so no head-to-head yet.

▮ REFACTORED PATCH

# FIX: move 'global processor' to the FIRST line of the function that assigns it,
# before any assignment to processor.