Paul Kompfner 7d3726a74b feat: support new async-tool mechanism in AWS Nova Sonic ...

Add support to AWSNovaSonicLLMService for the new "async tool call"
mechanism activated by `cancel_on_interruption=False`, which includes:

- delivering results asynchronously
- delivering result streams
- cancelling running async tools

Note that the introduction of the new mechanism had actually caused a
regression in AWS Nova Sonic, which previously supported
`cancel_on_interruption=False` with the old mechanism (simply avoiding
discarding tool calls on interruptions).

Support for the other major realtime services (`GeminiLiveLLMService`,
`OpenAIRealtimeLLMService`) will follow in a separate PR — Gemini Live
in particular needs more work before it can support long-running tool
calls reliably.

2026-05-06 11:36:15 -04:00

..

genesys

fix: always include parameters field in Genesys AudioHook messages

2026-03-20 16:37:53 -03:00

integration

Fix broken test_unified_function_calling_anthropic due to use of an unsupported/deprecated model.

2026-03-09 12:07:56 -04:00

__init__.py

tests: add some initial run_test() utilities

2025-01-20 17:41:21 -08:00

test_aggregators.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_aic_filter.py

update test description.

2026-03-10 14:54:49 +01:00

test_aic_vad.py

add unit tests for AICVADAnalyzer and AICFilter.

2026-01-26 09:56:36 +01:00

test_app_resources.py

feat: broaden tool_resources to app_resources

2026-04-30 16:16:17 -04:00

test_async_tool_messages.py

feat: support new async-tool mechanism in AWS Nova Sonic

2026-05-06 11:36:15 -04:00

test_audio_buffer_processor.py

Automated tests to validate the silence injection guards.

2026-03-25 16:05:58 -03:00

test_context_aggregators_universal.py

Fix on_assistant_turn_stopped not firing for empty LLM responses

2026-04-14 10:07:19 -07:00

test_context_summarization.py

Fix context summarization failing with mid-conversation system messages

2026-04-14 11:48:50 -04:00

test_daily_transport_service.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_deepgram_stt.py

Add tests for send_media() exception handling in DeepgramSTTService

2026-03-26 09:20:58 -04:00

test_direct_functions.py

Modernize Python typing across the codebase

2026-04-16 09:28:23 -07:00

test_dtmf_aggregator.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_fastapi_websocket.py

Fix FastAPI WebSocket disconnect race condition causing pipeline hang

2026-03-28 00:01:25 -04:00

test_filters.py

Simplify ServiceSwitcher with closure-based filters

2026-02-09 14:12:33 -05:00

test_frame_processor.py

Modernize Python typing across the codebase

2026-04-16 09:28:23 -07:00

test_function_calling_adapters.py

Merge pull request #4248 from omChauhanDev/add-openai-custom-tools-support

2026-04-10 10:27:28 -04:00

test_get_llm_invocation_params.py

Add system instruction conflict resolution tests for realtime adapters

2026-03-24 17:30:35 -04:00

test_google_utils.py

update examples and tests copyright and use a proper dash in 2024-2026

2026-01-07 19:32:22 -08:00

test_idle_frame_processor.py

Fix asyncio.Event race conditions in idle processors

2026-04-09 13:41:01 -07:00

test_ivr_navigation.py

Fix IVRNavigator to push AggregatedTextFrame when switching to conversation mode

2026-01-30 21:07:49 -05:00

test_krisp_ip_user_turn_start_strategy.py

test(krisp): scope importlib.metadata.version mock to imports only

2026-04-30 14:16:54 -04:00

test_krisp_sdk_manager.py

test(krisp): scope importlib.metadata.version mock to imports only

2026-04-30 14:16:54 -04:00

test_krisp_viva_filter.py

test(krisp): scope importlib.metadata.version mock to imports only

2026-04-30 14:16:54 -04:00

test_krisp_viva_vad.py

test(krisp): scope importlib.metadata.version mock to imports only

2026-04-30 14:16:54 -04:00

test_langchain.py

Fix langchain imports for langchain 1.x compatibility

2026-03-29 10:27:48 -04:00

test_livekit_transport.py

chore: install livekit as optional extra in CI instead of dev dep

2026-01-20 09:16:16 -05:00

test_llm_context_summarizer.py

Make max_context_tokens and max_unsummarized_messages independently optional

2026-03-03 20:08:22 -05:00

test_llm_context.py

Rename elide_large_values to truncate_large_values

2026-04-11 14:29:05 -04:00

test_llm_response.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_llm_service.py

test, refactor: follow-ups to LLMService generic refactor

2026-05-01 09:36:14 -04:00

test_markdown_text_filter.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_novita_llm.py

tests: migrate LLM tests to Settings-based constructor API

2026-04-10 17:37:49 -07:00

test_openai_llm_timeout.py

tests: migrate LLM tests to Settings-based constructor API

2026-04-10 17:37:49 -07:00

test_openai_responses_websocket.py

Introduce WebsocketLLMService and refactor OpenAIResponsesLLMService to use it

2026-03-30 22:26:31 -04:00

test_pattern_pair_aggregator.py

Remove deprecated add_pattern_pair method from PatternPairAggregator

2026-04-02 10:28:01 -04:00

test_pipeline.py

Modernize Python typing across the codebase

2026-04-16 09:28:23 -07:00

test_piper_tts.py

Fixing Piper test.

2026-03-09 12:07:45 -03:00

test_producer_consumer.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_protobuf_serializer.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_rnnoise_cancellation.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_rnnoise_filter.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_rnnoise_resampling.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_rtvi_processor.py

More RTVI version parsing improvements

2026-03-31 16:05:53 -04:00

test_run_inference.py

tests: migrate LLM tests to Settings-based constructor API

2026-04-10 17:37:49 -07:00

test_runner_utils.py

Apply suggestions from code review

2026-02-03 16:42:13 +08:00

test_sambanova_llm.py

tests: migrate LLM tests to Settings-based constructor API

2026-04-10 17:37:49 -07:00

test_service_init.py

Address code review feedback

2026-03-07 07:42:42 -05:00

test_service_language.py

Modernize Python typing across the codebase

2026-04-16 09:28:23 -07:00

test_service_switcher.py

Fix ServiceSwitcher reacting to pass-through ErrorFrames from other pipeline stages

2026-03-25 22:53:04 -04:00

test_settings.py

Add Inworld Realtime Service (#4140)

2026-04-09 13:04:17 -04:00

test_simple_text_aggregator.py

Add text_aggregation_mode parameter to TTSService

2026-02-26 08:55:41 -05:00

test_skip_tags_aggregator.py

Add text_aggregation_mode parameter to TTSService

2026-02-26 08:55:41 -05:00

test_startup_timing_observer.py

Replace per-processor start_time with start_offset_secs

2026-03-02 14:07:34 -05:00

test_sync_parallel_pipeline.py

Add frame_order parameter to SyncParallelPipeline

2026-03-19 09:43:51 -04:00

test_tracing_context.py

Add tests for TracingContext and TurnTraceObserver

2026-02-11 23:27:35 -05:00

test_tts_frame_ordering.py

feat(tts): add includes_inter_frame_spaces flag to word-timestamp API

2026-04-18 12:03:32 -07:00

test_turn_trace_observer.py

Add tests for TracingContext and TurnTraceObserver

2026-02-11 23:27:35 -05:00

test_turn_tracking_observer.py

update examples and tests copyright and use a proper dash in 2024-2026

2026-01-07 19:32:22 -08:00

test_user_bot_latency_observer.py

Add chronological_events utility function to display UserBotLatencyObserver report

2026-03-02 19:23:42 -05:00

test_user_idle_controller.py

Make UserIdleController always-on with dynamic timeout updates

2026-02-14 09:54:30 -05:00

test_user_mute_strategy.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_user_turn_completion_mixin.py

Move turn completion instructions to system_instruction

2026-03-08 10:41:40 -04:00

test_user_turn_controller.py

Fix stale state in user turn stop strategies between turns

2026-03-17 11:31:08 -04:00

test_user_turn_processor.py

Improve user turn stop timing by triggering timeout from VAD stop

2026-02-09 14:12:33 -05:00

test_user_turn_start_strategy.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_user_turn_stop_strategy.py

Split user-turn stop timeout into independent speech and STT timers

2026-04-20 11:55:09 -04:00

test_utils_network.py

tests: add unittest.main() call

2026-01-30 10:07:34 -08:00

test_utils_string.py

Fix sentence splitting for CJK and other non-Latin languages in TTS pipeline

2026-02-02 14:27:49 +08:00

test_vad_controller.py

Modernize Python typing across the codebase

2026-04-16 09:28:23 -07:00

test_vad_processor.py

Modernize Python typing across the codebase

2026-04-16 09:28:23 -07:00

test_wake_phrase_user_turn_start_strategy.py

tests: yield in wake phrase strategy setup to let tasks start

2026-04-10 17:37:50 -07:00

test_websocket_service.py

Improve tests

2026-03-30 12:46:30 -04:00

test_websocket_transport.py

update examples and tests copyright and use a proper dash in 2024-2026

2026-01-07 19:32:22 -08:00

test_xai_tts.py

Add XAITTSService for xAI streaming WebSocket TTS

2026-04-21 15:48:26 -04:00