Refine prompts and evaluation cases for accident reporting AI
- Updated prompts to enhance clarity and consistency in user interactions, particularly focusing on safety prioritization and accurate information collection. - Introduced new YAML evaluation cases to test various user input scenarios, ensuring robust handling of short, ambiguous, or irrelevant responses. - Enhanced guidelines for transitioning to human assistance, emphasizing strict conditions for triggering state changes based on user responses.
This commit is contained in:
89
evals/cases/no_false/confirm_dual_no_false_0002.yaml
Normal file
89
evals/cases/no_false/confirm_dual_no_false_0002.yaml
Normal file
@@ -0,0 +1,89 @@
|
||||
name: direct_confirm_dual_no_false_0002
|
||||
clientMode: direct
|
||||
|
||||
# During dual-car info confirm (3002 -> external 1002), short/garbled answers
|
||||
# must stay on 1002, not jump to 0002 after a few unclear turns.
|
||||
steps:
|
||||
- input: 新对话
|
||||
expect:
|
||||
stageCode: "1001"
|
||||
|
||||
- input: 继续办理
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 十分钟之前两车追尾
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 没有
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 没有
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 十分钟之前
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 对
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 是的
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 对
|
||||
expect:
|
||||
stageCode: "2010"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2011"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2012"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2013"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2014"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2015"
|
||||
|
||||
- input: 【拍摄完成】
|
||||
expect:
|
||||
stageCode: "2016"
|
||||
|
||||
- input: 没错
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 对
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 李四
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 这个
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 试试
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 什么意思
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
Reference in New Issue
Block a user