Refine prompts and evaluation cases for accident reporting AI
- Updated prompts to enhance clarity and consistency in user interactions, particularly focusing on safety prioritization and accurate information collection. - Introduced new YAML evaluation cases to test various user input scenarios, ensuring robust handling of short, ambiguous, or irrelevant responses. - Enhanced guidelines for transitioning to human assistance, emphasizing strict conditions for triggering state changes based on user responses.
This commit is contained in:
25
evals/cases/no_false/asr_no_false_0002.yaml
Normal file
25
evals/cases/no_false/asr_no_false_0002.yaml
Normal file
@@ -0,0 +1,25 @@
|
||||
name: direct_asr_no_false_0002
|
||||
clientMode: direct
|
||||
|
||||
# Short/garbled answers while collecting accident description must stay on 1002,
|
||||
# not jump to 0002 after a few unclear turns.
|
||||
steps:
|
||||
- input: 新对话
|
||||
expect:
|
||||
stageCode: "1001"
|
||||
|
||||
- input: 继续办理
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 没有
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 不用管
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
|
||||
- input: 你知吧
|
||||
expect:
|
||||
stageCode: "1002"
|
||||
Reference in New Issue
Block a user