Grade Qwen 6-bit on webhook prompt: 75/100 Minor Flaws (runs, all 4 tests pass)
Fourth data point on Qwen 3.6 35B-A3B 6-bit MLX: LFU cache 82 (runs) Webhook 75 (runs, all tests pass) <- best non-LFU result TTS pipeline 49 (doesn't parse) Rust service 50 (7 compile errors) Profile sharpens: Qwen 6-bit handles SINGLE-HANDLER logic well (webhook HMAC/idempotency/rate-limit/429-backoff all correct) but fails on multi-task orchestration (TTS) and typed/compiled langs (Rust). Safe offload for HTTP/bridge/verification work; not for pipelines or Rust. Added webhook prompt_id + pillar set. (Initial paste was mangled - stripped '=' signs - re-pasted clean.) Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
@@ -20,6 +20,7 @@ PILLARS_BY_PROMPT = {
|
||||
"rust": ["ownership", "concurrency", "error_handling", "cancellation", "test_integrity"],
|
||||
"data": ["query_safety", "pooling", "transactions", "pagination", "test_integrity"],
|
||||
"automation": ["idempotency", "retry_backoff", "checkpointing", "signal_handling", "test_integrity"],
|
||||
"webhook": ["schema_io", "transport", "error_handling", "state_safety", "test_integrity"],
|
||||
}
|
||||
PILLARS = PILLARS_BY_PROMPT["lfu"] # default for any code that still references the global
|
||||
PILLAR_LABELS = {
|
||||
|
||||
Reference in New Issue
Block a user