Commit Graph

65 Commits

Author SHA1 Message Date
Xin Wang
8a39461b21 fix duplicate assistant text events 2026-06-01 08:41:00 +08:00
Xin Wang
402ad81cb6 Add chatId in ws connection 2026-05-31 22:46:48 +08:00
Xin Wang
5cbfd0f0fa Refactor TTS configuration in fastgpt.state.xfyun.json: update provider, base URL, voice settings, and adjust sample rate for improved performance. 2026-05-29 16:47:07 +08:00
Xin Wang
991c8a02e7 Update idle count will reset when user active again 2026-05-29 16:44:01 +08:00
Xin Wang
050ecc7a2d Fix idle and text input race bug 2026-05-29 16:05:23 +08:00
Xin Wang
15c98f21fe Use FastGPT app opener for greetings 2026-05-29 15:34:33 +08:00
Xin Wang
ce3c384b00 Adjust user speech timeout and enhance idle prompt settings in fastgpt.state.xfyun.json and siliconflow.json 2026-05-29 13:39:17 +08:00
Xin Wang
d5e4085883 Update TTS configuration and idle prompt settings in fastgpt.state.xfyun.json and fastgpt.xfyun.supertts.json 2026-05-29 13:36:32 +08:00
Xin Wang
4c4e3e949f Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-29 12:56:47 +08:00
Xin Wang
b6cb72eda7 Remove unused config 2026-05-29 12:56:31 +08:00
Xin Wang
8319aea642 Fix idle prompt handling 2026-05-29 12:55:56 +08:00
Xin Wang
cc418e5f7e Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-29 12:37:41 +08:00
Xin Wang
ca6d263dfb Update idle to bot stop 2026-05-29 12:37:21 +08:00
Xin Wang
1e1f89906d Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-29 12:23:17 +08:00
Xin Wang
6ebb20ae50 Update idle timer 2026-05-29 12:22:55 +08:00
Xin Wang
f7df8bbda1 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-29 11:06:57 +08:00
Xin Wang
69c5941139 Update idle prompt 2026-05-29 11:01:24 +08:00
Xin Wang
d5836b75bd Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-28 15:08:57 +08:00
Xin Wang
b4804c3884 Update voice demo center text 2026-05-28 15:08:42 +08:00
Xin Wang
3bcdcced9d Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-28 15:03:46 +08:00
Xin Wang
a5839e5668 Update camera drawer font to lighter 2026-05-28 15:03:28 +08:00
Xin Wang
6ec67263bf Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-28 14:54:43 +08:00
Xin Wang
966dadda38 Add camera drawer for voice demo 2026-05-28 14:52:44 +08:00
Xin Wang
29828d5bb4 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-28 14:29:30 +08:00
Xin Wang
1dcfb98e63 Add set_info input event 2026-05-28 14:29:00 +08:00
Xin Wang
f954da60b4 Update voice activity detection parameters and add response state configuration in FastGPT XFYun JSON files for enhanced interaction management. 2026-05-28 13:57:33 +08:00
Xin Wang
3357585443 Add response state configuration to FastGPT XFYun JSON file, enabling state tracking with customizable parameters for improved interaction management. 2026-05-28 13:36:14 +08:00
Xin Wang
ad232fdbd9 Add configuration files for FastGPT with XFYun services, including STT, TTS, and audio filtering settings. Introduce new JSON files for different service configurations and enhance logging for text delta responses in the web application. 2026-05-28 13:28:36 +08:00
Xin Wang
2d5fd65721 Add demo page shows state code 2026-05-28 10:01:27 +08:00
Xin Wang
d94da4b4d1 Add support for prefix state code 2026-05-28 09:36:44 +08:00
Xin Wang
8c3789754f Add xfyun super tts service 2026-05-27 20:04:36 +08:00
Xin Wang
5328b90e2e Update deepfilternet readme and config 2026-05-27 16:40:21 +08:00
Xin Wang
673a54049a Add deepfilternet 2026-05-27 16:37:14 +08:00
Xin Wang
c4a53b5205 Add voice activity detection and interruption handling configurations to FastGPT and XFYun JSON files. Enhance interruption short replies with additional phrases for improved user interaction. 2026-05-26 15:45:25 +08:00
Xin Wang
7ab10eba32 Rename browser demo mount path from /demo to /voice-demo.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-26 14:37:21 +08:00
Xin Wang
d64a5315a5 update fastgpt config 2026-05-26 14:30:18 +08:00
Xin Wang
97deca0f57 Update LLM configuration to support FastGPT integration. Modify requirements to include fastgpt-python-sdk, enhance greeting messages, and adjust LLM service creation to handle app_id. Implement welcome text fetching for FastGPT and improve context handling in the pipeline based on LLM provider. Update related configurations and properties for better integration. 2026-05-26 14:15:26 +08:00
Xin Wang
3dfff0c937 Add AssistantContextSyncProcessor to manage LLM context synchronization during assistant interruptions. Update ProductTextStreamProcessor to track last streamed text and modify pipeline to integrate new context sync functionality. Enhance tests to verify context sync behavior for interrupted assistant turns. 2026-05-26 10:44:12 +08:00
Xin Wang
e7a8cb1faa Enhance text stream processing by adding synchronization for interrupted assistant turns. Introduce sync_streamed_assistant_context to align LLM context with UI text, and modify ProductTextStreamProcessor to handle interrupted text. Update pipeline to utilize the new functionality for managing assistant turn interruptions. 2026-05-26 08:33:02 +08:00
Xin Wang
2edcb51805 Add chat_id, variables, detail, timeout_sec, and send_system_prompt to LLMConfig; update create_llm_service to accept new parameters and handle FastGPT integration. Modify pipeline to utilize chat_id and adjust message handling based on provider settings. 2026-05-25 08:45:30 +08:00
Xin Wang
b918eec5c1 Fix text stream frame forwarding order and transport message type.
Push LLM/TTS frames downstream before emitting product events so the pipeline keeps correct ordering, and use OutputTransportMessageFrame instead of the urgent variant.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-24 21:56:04 +08:00
Xin Wang
f301af396d Update AGENTS.md with additional context on implementation and modify pipeline.py to include assistant aggregator in the processing flow. 2026-05-24 21:37:54 +08:00
Xin Wang
003a4abe8c Collapse high-frequency audio frames in the demo websocket log.
Expandable groups keep protocol and text events readable while still allowing per-frame inspection when debugging audio traffic.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-23 10:21:50 +08:00
Xin Wang
5b087f8610 Add input image to product protocol 2026-05-23 08:28:56 +08:00
Xin Wang
02db9545f0 fix text input no context update 2026-05-22 21:30:54 +08:00
Xin Wang
7267c06552 Add Chinese docs for product WebSocket usage.
Document va.ws.v1 protocol, client messages, server events, and interrupted flag behavior for product clients.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-22 15:10:15 +08:00
Xin Wang
f73fadcc77 Add interruption handling parameters to siliconflow configuration 2026-05-22 13:52:36 +08:00
Xin Wang
73f0fdf7bf Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-22 13:40:05 +08:00
Xin Wang
2c26eeff35 Update turn parameters 2026-05-22 13:38:47 +08:00
Xin Wang
75a34bf071 Add gated turn start strategy 2026-05-22 13:36:47 +08:00