◂ BACK TO LEADERBOARD
▚ MODEL AUDIT // 6-bit MLX

// Qwen 3.6 35B-A3B

FLAWS — Minor Logic Flaws 75/100 tests: PASS
tok/sec69.24
tokens12595
TTFT0.95s

▮ PILLAR BREAKDOWN

Schema / I/O
16/20
Transport
14/20
Error Handling
16/20
State Safety
14/20
Test Integrity
15/20

✓ WENT RIGHT

  • Schema / I/O (16/20)
  • Error Handling (16/20)

✗ WENT WRONG

  • No pillar fell below 14 — solid across the board.

▮ CRITICAL BUGS

▮ RECOMMENDED USE

Best non-LFU result for this model (75 vs TTS 49, Rust 50). Runs clean, passes all 4 tests, implements HMAC + idempotency + token-bucket rate-limit + 429 backoff correctly. Safe to offload single-handler HTTP/bridge logic (webhooks, signature verification, rate-limited forwarding). AVOID for multi-task orchestration (TTS) and typed/compiled languages (Rust).

▮ REFACTORED PATCH

# FIX 1 (clock): use monotonic for TTL too.
class IdempotencyStore:
    def is_seen(self, event_id):
        now = time.monotonic()
        ...
    def mark(self, event_id):
        self.store[event_id] = time.monotonic()

# FIX 2 (body cap): reject oversized bodies before reading.
MAX_BODY = 64 * 1024
content_length = int(headers.get('content-length', 0))
if content_length > MAX_BODY:
    writer.write(b'HTTP/1.1 413 Payload Too Large\r\nContent-Length: 0\r\n\r\n'); await writer.drain(); return
body = await reader.readexactly(content_length) if 0 < content_length <= MAX_BODY else b''

# FIX 3 (leak): bound forward_timestamps (deque maxlen=N) or drop it if unused.
from collections import deque
self.forward_timestamps: deque = deque(maxlen=1000)

# FIX 4 (reason phrase): use a fixed map.
REASON = {200:'OK',400:'Bad Request',401:'Unauthorized',404:'Not Found',502:'Bad Gateway',500:'Internal Server Error'}
response = f'HTTP/1.1 {status} {REASON.get(status,"OK")}\r\n...'

# FIX 5: add tests for the 400 (malformed JSON) and missing-signature 401 paths.