Refine prompts and evaluation cases for accident reporting AI

- Updated prompts to enhance clarity and consistency in user interactions, particularly focusing on safety prioritization and accurate information collection.
- Introduced new YAML evaluation cases to test various user input scenarios, ensuring robust handling of short, ambiguous, or irrelevant responses.
- Enhanced guidelines for transitioning to human assistance, emphasizing strict conditions for triggering state changes based on user responses.
This commit is contained in:
Xin Wang
2026-07-30 14:19:57 +08:00
parent be35e48686
commit f40643dd87
16 changed files with 1039 additions and 68 deletions

View File

@@ -6,7 +6,7 @@ During the run it also prints the live dialogue and saves transcripts.
## Case format
Add YAML files anywhere under `evals/cases/`:
Add YAML files anywhere under `evals/cases/` (e.g. `direct/`, `browser_addon/`, `no_false/` for false-interrupt / false-transfer checks):
```yaml
name: direct_initial_stage
@@ -45,6 +45,7 @@ Run selected cases:
```bash
python evals/run.py --case direct
python evals/run.py --case browser_addon
python evals/run.py --case no_false
```
## Dialogue and transcripts