Grade Qwen 6-bit on webhook prompt: 75/100 Minor Flaws (runs, all 4 tests pass)

Fourth data point on Qwen 3.6 35B-A3B 6-bit MLX:
  LFU cache    82  (runs)
  Webhook     75  (runs, all tests pass) <- best non-LFU result
  TTS pipeline 49  (doesn't parse)
  Rust service 50  (7 compile errors)

Profile sharpens: Qwen 6-bit handles SINGLE-HANDLER logic well
(webhook HMAC/idempotency/rate-limit/429-backoff all correct) but fails
on multi-task orchestration (TTS) and typed/compiled langs (Rust).
Safe offload for HTTP/bridge/verification work; not for pipelines or Rust.

Added webhook prompt_id + pillar set. (Initial paste was mangled -
stripped '=' signs - re-pasted clean.)

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
2026-07-28 18:03:50 -07:00
co-authored by Claude
parent e3d73de36a
commit 241298b410
3 changed files with 340 additions and 0 deletions
+1
View File
@@ -20,6 +20,7 @@ PILLARS_BY_PROMPT = {
"rust": ["ownership", "concurrency", "error_handling", "cancellation", "test_integrity"],
"data": ["query_safety", "pooling", "transactions", "pagination", "test_integrity"],
"automation": ["idempotency", "retry_backoff", "checkpointing", "signal_handling", "test_integrity"],
"webhook": ["schema_io", "transport", "error_handling", "state_safety", "test_integrity"],
}
PILLARS = PILLARS_BY_PROMPT["lfu"] # default for any code that still references the global
PILLAR_LABELS = {