Refine prompts and evaluation cases for accident reporting AI
- Updated prompts to enhance clarity and consistency in user interactions, particularly focusing on safety prioritization and accurate information collection. - Introduced new YAML evaluation cases to test various user input scenarios, ensuring robust handling of short, ambiguous, or irrelevant responses. - Enhanced guidelines for transitioning to human assistance, emphasizing strict conditions for triggering state changes based on user responses.
This commit is contained in:
73
evals/cases/no_false/confirm_single_no_false_0003.yaml
Normal file
73
evals/cases/no_false/confirm_single_no_false_0003.yaml
Normal file
@@ -0,0 +1,73 @@
|
||||
name: direct_confirm_single_no_false_0003
|
||||
clientMode: direct
|
||||
|
||||
# During single-car info confirm, ASR damage/garbled injury-like words must not
|
||||
# jump to 0003; stay on 1002 (closed confirm / continue current question).
|
||||
steps:
|
||||
- input: 新对话
|
||||
expect:
|
||||
stageCode: "1001"
|
||||
|
||||
- input: 继续办理
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 十分钟之前一辆车撞到护栏
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 没有
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 没有
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 对
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 对
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 对
|
||||
expect:
|
||||
stageCode: "2000"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2001"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2002"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2003"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2004"
|
||||
|
||||
- input: 是的
|
||||
expect:
|
||||
stageCode: "2005"
|
||||
|
||||
- input: 前方
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 是的
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 不,刚摧毁了
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 伤……没有吧
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
Reference in New Issue
Block a user