Files
modelTesting/tools
adminandClaude b82c665ec6 Add tools/grade_run.py: call LM Studio API, save output + capture metrics
Replaces clipboard-based submission (which was mangling outputs).
Run from any LAN host that can reach LM Studio:
  python3 tools/grade_run.py --lmstudio http://10.0.0.31:1234 --list
  python3 tools/grade_run.py --model <id> --prompt tts --name <slug> --append

Saves the raw completion to outputs/<name>.<ext> (no clipboard),
captures tok/sec + tokens + TTFT from the API response (no manual
entry), and drafts a pending JSON entry. The 5-pillar audit still
done by hand (subjective). TODO_submission_tool.md updated.

Co-Authored-By: Claude <noreply@anthropic.com>
2026-07-28 18:16:00 -07:00
..