Refine prompts and evaluation cases for accident reporting AI
- Updated prompts to enhance clarity and consistency in user interactions, particularly focusing on safety prioritization and accurate information collection. - Introduced new YAML evaluation cases to test various user input scenarios, ensuring robust handling of short, ambiguous, or irrelevant responses. - Enhanced guidelines for transitioning to human assistance, emphasizing strict conditions for triggering state changes based on user responses.
This commit is contained in:
81
evals/cases/no_false/confirm_single_no_false_0002.yaml
Normal file
81
evals/cases/no_false/confirm_single_no_false_0002.yaml
Normal file
@@ -0,0 +1,81 @@
|
||||
name: direct_confirm_single_no_false_0002
|
||||
clientMode: direct
|
||||
|
||||
# During single-car info confirm (3001 -> external 1002), short/garbled answers
|
||||
# must stay on 1002, not jump to 0002 after a few unclear turns.
|
||||
steps:
|
||||
- input: 新对话
|
||||
expect:
|
||||
stageCode: "1001"
|
||||
|
||||
- input: 继续办理
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 十分钟之前一辆车撞到护栏
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 没有
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 没有
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 对
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 对
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 对
|
||||
expect:
|
||||
stageCode: "2000"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2001"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2002"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2003"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2004"
|
||||
|
||||
- input: 是的
|
||||
expect:
|
||||
stageCode: "2005"
|
||||
|
||||
- input: 前方
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 是的
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 张三
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 这个
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 试试
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 什么意思
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
Reference in New Issue
Block a user