|
|
|
|
@@ -1,10 +1,10 @@
|
|
|
|
|
- Introducing user and bot turn start strategies. Turn start strategies indicate when user and bot turns begin. In conversational agents, these are often referred to as start/stop speaking or turn-taking plans or policies.
|
|
|
|
|
- Introducing user turn strategies. User turn strategies indicate when the user turn starts or stops. In conversational agents, these are often referred to as start/stop speaking or turn-taking plans or policies.
|
|
|
|
|
|
|
|
|
|
User turn start strategies indicate when the user starts speaking (e.g. using VAD events or when a user says one or more words).
|
|
|
|
|
|
|
|
|
|
Bot turn start strategies indicate when the bot should start speaking (e.g. using an end-of-turn detection model or by observing incoming transcriptions).
|
|
|
|
|
User turn stop strategies indicate when the user stops speaking (e.g. using an end-of-turn detection model or by observing incoming transcriptions).
|
|
|
|
|
|
|
|
|
|
A list of strategies can be specified for both the user and the bot; strategies are evaluated in order until one evaluates to true.
|
|
|
|
|
A list of strategies can be specified for both strategies; strategies are evaluated in order until one evaluates to true.
|
|
|
|
|
|
|
|
|
|
Available user turn start strategies:
|
|
|
|
|
- VADUserTurnStartStrategy
|
|
|
|
|
@@ -12,25 +12,25 @@
|
|
|
|
|
- MinWordsUserTurnStartStrategy
|
|
|
|
|
- ExternalUserTurnStartStrategy
|
|
|
|
|
|
|
|
|
|
Available bot turn start strategies:
|
|
|
|
|
- TranscriptionBotTurnStartStrategy
|
|
|
|
|
- TurnAnalyzerBotTurnStartStrategy
|
|
|
|
|
- ExternalBotTurnStartStrategy
|
|
|
|
|
Available user turn stop strategies:
|
|
|
|
|
- TranscriptionUserTurnStopStrategy
|
|
|
|
|
- TurnAnalyzerUserTurnStopStrategy
|
|
|
|
|
- ExternalUserTurnStopStrategy
|
|
|
|
|
|
|
|
|
|
The default strategies are:
|
|
|
|
|
|
|
|
|
|
- user: [VADUserTurnStartStrategy, TranscriptionUserTurnStartStrategy]
|
|
|
|
|
- bot: [TranscriptionBotTurnStartStrategy]
|
|
|
|
|
- start: [VADUserTurnStartStrategy, TranscriptionUserTurnStartStrategy]
|
|
|
|
|
- stop: [TranscriptionUserTurnStopStrategy]
|
|
|
|
|
|
|
|
|
|
Turn start strategies are configured when setting up `LLMContextAggregatorPair`. For example:
|
|
|
|
|
Turn strategies are configured when setting up `LLMContextAggregatorPair`. For example:
|
|
|
|
|
|
|
|
|
|
```python
|
|
|
|
|
context_aggregator = LLMContextAggregatorPair(
|
|
|
|
|
context,
|
|
|
|
|
user_params=LLMUserAggregatorParams(
|
|
|
|
|
turn_start_strategies=TurnStartStrategies(
|
|
|
|
|
bot=[
|
|
|
|
|
TurnAnalyzerBotTurnStartStrategy(
|
|
|
|
|
user_turn_strategies=UserTurnStrategies(
|
|
|
|
|
stop=[
|
|
|
|
|
TurnAnalyzerUserTurnStopStrategy(
|
|
|
|
|
turn_analyzer=LocalSmartTurnAnalyzerV3(params=SmartTurnParams())
|
|
|
|
|
)
|
|
|
|
|
],
|
|
|
|
|
@@ -39,4 +39,4 @@
|
|
|
|
|
)
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
In order to use the turn start strategies you should update to the new universal `LLMContext` and `LLMContextAggregatorPair`.
|
|
|
|
|
In order to use the user turn strategies you must update to the new universal `LLMContext` and `LLMContextAggregatorPair`.
|
|
|
|
|
|