adminandClaude 0c79a997f5 Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet) ...

Via tools/grade_run.py against LM Studio (load -> all prompts -> unload -> verify).
kat-coder:      lfu/tts/webhook/automation/rust  (lfu has a real SyntaxError: 'self._ bump_freq')
qwen3-coder-30b: lfu/tts/webhook/automation/rust  (all 4 py parse clean; terse ~2k tok outputs)
Grading deferred to a later session (capture-only mode).

Script hardening:
  - --resident / --unload-all commands (read loaded_instances, POST unload, verify)
  - MEMORY GUARD: aborts if a different model is resident (never stack 30GB models)
  - TTFT self-discovery dump (LM Studio returns empty stats non-streaming;
    fix next session: switch to /api/v1/chat stream:true -> chat.end result.stats)

Co-Authored-By: Claude <noreply@anthropic.com>

2026-07-28 19:22:41 -07:00

..

.last_response_schema.json

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

gemma4-26b-a4b-8bit-mlx-automation.py

Gemma 4 26B-A4B head-to-head vs Qwen (4 prompts, via grade_run.py API)

2026-07-28 18:42:58 -07:00

gemma4-26b-a4b-8bit-mlx-rust.rs

Gemma 4 26B-A4B head-to-head vs Qwen (4 prompts, via grade_run.py API)

2026-07-28 18:42:58 -07:00

gemma4-26b-a4b-8bit-mlx-tts.py

Gemma 4 26B-A4B head-to-head vs Qwen (4 prompts, via grade_run.py API)

2026-07-28 18:42:58 -07:00

gemma4-26b-a4b-8bit-mlx-webhook.py

Gemma 4 26B-A4B head-to-head vs Qwen (4 prompts, via grade_run.py API)

2026-07-28 18:42:58 -07:00

gemma4-26b-a4b-8bit-mlx.py

Grade 3 more models + dashboard v2 layout (quant/format as first-class)

2026-07-28 16:51:50 -07:00

gemma4-31b-gguf.py

Initial benchmark suite: 8 graded models + cyberpunk dashboard generator

2026-07-28 14:00:40 -07:00

gemma-4-12b-coder-fable5-composer2.5-v1-uncensored-heretic-mxfp8-mlx.py

Initial benchmark suite: 8 graded models + cyberpunk dashboard generator

2026-07-28 14:00:40 -07:00

gemma-4-31b-qat-gguf.py

Initial benchmark suite: 8 graded models + cyberpunk dashboard generator

2026-07-28 14:00:40 -07:00

kat-coder-v2.5-dev-xl-mlx-automation.py

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

kat-coder-v2.5-dev-xl-mlx-lfu.py

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

kat-coder-v2.5-dev-xl-mlx-rust.rs

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

kat-coder-v2.5-dev-xl-mlx-tts.py

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

kat-coder-v2.5-dev-xl-mlx-webhook.py

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

kat-coder-v2.5-dev-xl-mlx.py

Initial benchmark suite: 8 graded models + cyberpunk dashboard generator

2026-07-28 14:00:40 -07:00

qwen3-coder-30b-6bit-mlx-automation.py

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

qwen3-coder-30b-6bit-mlx-lfu.py

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

qwen3-coder-30b-6bit-mlx-rust.rs

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

qwen3-coder-30b-6bit-mlx-tts.py

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

qwen3-coder-30b-6bit-mlx-webhook.py

Capture kat-coder + qwen3-coder-30b outputs (5 prompts each, API-run, NOT graded yet)

2026-07-28 19:22:41 -07:00

qwen3-coder-30b-6bit-mlx.py

Grade 3 more models + dashboard v2 layout (quant/format as first-class)

2026-07-28 16:51:50 -07:00

qwen3.6-27b-8bit-mlx.py

Grade 3 more models + dashboard v2 layout (quant/format as first-class)

2026-07-28 16:51:50 -07:00

qwen3.6-35b-a3b-4bit-mlx.py

Initial benchmark suite: 8 graded models + cyberpunk dashboard generator

2026-07-28 14:00:40 -07:00

qwen3.6-35b-a3b-6bit-mlx-rust.rs

Grade Qwen 6-bit on Rust prompt: 50/100 Critical (does not compile, 7 errors)

2026-07-28 17:53:15 -07:00

qwen3.6-35b-a3b-6bit-mlx-tts.py

First multi-prompt result: Qwen 6-bit TTS = 49 (vs 82 LFU) + per-prompt schema

2026-07-28 17:43:38 -07:00

qwen3.6-35b-a3b-6bit-mlx-webhook.py

Grade Qwen 6-bit on webhook prompt: 75/100 Minor Flaws (runs, all 4 tests pass)

2026-07-28 18:03:50 -07:00

qwen3.6-35b-a3b-6bit-mlx.py

Initial benchmark suite: 8 graded models + cyberpunk dashboard generator

2026-07-28 14:00:40 -07:00

qwen3.6-35b-a3b-uncensored-hauhaucs-aggressive-gguf.py

Initial benchmark suite: 8 graded models + cyberpunk dashboard generator

2026-07-28 14:00:40 -07:00