adminandClaude e3d73de36a Grade Qwen 6-bit on Rust prompt: 50/100 Critical (does not compile, 7 errors) ...

Third data point on the same model:
  Qwen 3.6 35B-A3B 6-bit MLX:
    LFU cache    82  (runs clean)
    TTS pipeline 49  (doesn't parse)
    Rust service 50  (7 compile errors)

Profile is now sharp: strong on single-file Python data-structure/ACID
work; repeatedly ships non-compiling/non-parsing code on multi-task async
and typed-language prompts. Keep it on Python ACID tasks; do NOT offload
Rust or async-pipeline work.

Verified with cargo 1.94 (mpsc::bounded hallucination, ownership moves,
dead test override, broken remove_watcher). Lang field added for non-Python.

Co-Authored-By: Claude <noreply@anthropic.com>

2026-07-28 17:53:15 -07:00

..

benchmark_history.json

Grade Qwen 6-bit on Rust prompt: 50/100 Critical (does not compile, 7 errors)

2026-07-28 17:53:15 -07:00