Via tools/grade_run.py against LM Studio (load -> all prompts -> unload -> verify).
kat-coder: lfu/tts/webhook/automation/rust (lfu has a real SyntaxError: 'self._ bump_freq')
qwen3-coder-30b: lfu/tts/webhook/automation/rust (all 4 py parse clean; terse ~2k tok outputs)
Grading deferred to a later session (capture-only mode).
Script hardening:
- --resident / --unload-all commands (read loaded_instances, POST unload, verify)
- MEMORY GUARD: aborts if a different model is resident (never stack 30GB models)
- TTFT self-discovery dump (LM Studio returns empty stats non-streaming;
fix next session: switch to /api/v1/chat stream:true -> chat.end result.stats)
Co-Authored-By: Claude <noreply@anthropic.com>
12 lines
235 B
JSON
12 lines
235 B
JSON
{
|
|
"usage": {
|
|
"prompt_tokens": 621,
|
|
"completion_tokens": 1795,
|
|
"total_tokens": 2416,
|
|
"completion_tokens_details": {
|
|
"reasoning_tokens": 0
|
|
}
|
|
},
|
|
"stats": {},
|
|
"system_fingerprint": "qwen/qwen3-coder-30b"
|
|
} |