◂ BACK TO LEADERBOARD
▚ MODEL AUDIT // 8-bit MLX

// Gemma 4 26B-A4B

FLAWS — Minor Logic Flaws 72/100 tests: CRASH
tok/sec58.56
tokens4972
TTFT—

▮ PILLAR BREAKDOWN

Ownership / Types
17/20
Concurrency / Races
15/20
Error Handling
14/20
Cancellation / Shutdown
13/20
Test Integrity
13/20

✓ WENT RIGHT

  • Ownership / Types (17/20)

✗ WENT WRONG

  • Cancellation / Shutdown (13/20)
  • Test Integrity (13/20)

▮ CRITICAL BUGS

▮ RECOMMENDED USE

DECISIVE: Rust COMPILES CLEAN (0 errors with deps declared) where Qwen had 7 real compile errors (mpsc::bounded hallucination, ownership moves). The code is structurally sound Rust. Deductions only for undeclared deps + markdown wrapping. Gemma is the better Rust offload pick by a wide margin.

▮ REFACTORED PATCH

# FIX 1 (deps): add to Cargo.toml:
#   tokio-util = "0.7"
#   rand = "0.8"
# FIX 2: grade_run.py extractor now prefers the ```rust fence; this won't recur.