Enhance evaluation runner with transcript handling and new case formats

- Updated the evaluation runner to support live dialogue printing and transcript saving in both Markdown and JSON formats.
- Introduced new data classes for managing transcripts and their components, improving structure and readability.
- Modified existing YAML case files to align with the new direct client mode and updated stage codes.
- Added new test cases for the direct client mode, ensuring comprehensive coverage of user interactions.
This commit is contained in:
Xin Wang
2026-07-29 11:13:07 +08:00
parent e6437ab332
commit 4e621e2f0c
5 changed files with 406 additions and 34 deletions

3
.gitignore vendored
View File

@@ -2,4 +2,5 @@
__pycache__/
logs/
*.log
.env
.env
evals/results/