77 Commits

Author SHA1 Message Date
Xin Wang
e7a8cb1faa Enhance text stream processing by adding synchronization for interrupted assistant turns. Introduce sync_streamed_assistant_context to align LLM context with UI text, and modify ProductTextStreamProcessor to handle interrupted text. Update pipeline to utilize the new functionality for managing assistant turn interruptions. 2026-05-26 08:33:02 +08:00
Xin Wang
2edcb51805 Add chat_id, variables, detail, timeout_sec, and send_system_prompt to LLMConfig; update create_llm_service to accept new parameters and handle FastGPT integration. Modify pipeline to utilize chat_id and adjust message handling based on provider settings. 2026-05-25 08:45:30 +08:00
Xin Wang
b918eec5c1 Fix text stream frame forwarding order and transport message type.
Push LLM/TTS frames downstream before emitting product events so the pipeline keeps correct ordering, and use OutputTransportMessageFrame instead of the urgent variant.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-24 21:56:04 +08:00
Xin Wang
f301af396d Update AGENTS.md with additional context on implementation and modify pipeline.py to include assistant aggregator in the processing flow. 2026-05-24 21:37:54 +08:00
Xin Wang
003a4abe8c Collapse high-frequency audio frames in the demo websocket log.
Expandable groups keep protocol and text events readable while still allowing per-frame inspection when debugging audio traffic.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-23 10:21:50 +08:00
Xin Wang
5b087f8610 Add input image to product protocol 2026-05-23 08:28:56 +08:00
Xin Wang
02db9545f0 fix text input no context update 2026-05-22 21:30:54 +08:00
Xin Wang
7267c06552 Add Chinese docs for product WebSocket usage.
Document va.ws.v1 protocol, client messages, server events, and interrupted flag behavior for product clients.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-22 15:10:15 +08:00
Xin Wang
f73fadcc77 Add interruption handling parameters to siliconflow configuration 2026-05-22 13:52:36 +08:00
Xin Wang
73f0fdf7bf Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-22 13:40:05 +08:00
Xin Wang
2c26eeff35 Update turn parameters 2026-05-22 13:38:47 +08:00
Xin Wang
75a34bf071 Add gated turn start strategy 2026-05-22 13:36:47 +08:00
Xin Wang
2c7f0f440b demo mount to fastapi 2026-05-22 10:23:17 +08:00
Xin Wang
0d82acc0d2 Remove xfyun asr interim in frontend 2026-05-22 09:40:16 +08:00
Xin Wang
dab2d0593e Update xfyun asr service 2026-05-22 08:37:31 +08:00
Xin Wang
c0fb0c51a2 Update xfyun asr streaming boundary 2026-05-22 00:06:15 +08:00
Xin Wang
2ecb3ef506 update xfyun asr 2026-05-21 20:48:24 +08:00
Xin Wang
872b8ac64a move vad config to json 2026-05-21 17:23:04 +08:00
Xin Wang
6a59df3dbd xfyun asr update one bubble 2026-05-21 17:05:20 +08:00
Xin Wang
b09ca18cb9 update bugs 2026-05-21 16:52:42 +08:00
Xin Wang
7d36735c04 Fix xfyun asr tts error 2026-05-21 16:27:24 +08:00
Xin Wang
404381c818 Add xfyun asr service 2026-05-21 15:42:49 +08:00
Xin Wang
c83c172511 Update readme 2026-05-21 14:50:39 +08:00
Xin Wang
321a4bb5bf add xfyun tts service 2026-05-21 14:48:04 +08:00
Xin Wang
f3eab5b272 Add audio logging and WebSocket enhancements to webpage
- Introduced new state properties for audio send logging.
- Implemented functions to flush audio send logs and handle binary data sending.
- Updated WebSocket logging to differentiate between send and receive actions.
- Enhanced UI layout and styles for better responsiveness and usability.
- Improved overall structure and readability of the code.
2026-05-21 14:25:20 +08:00
Xin Wang
092f532f51 Update webpage 2026-05-21 14:11:45 +08:00
Xin Wang
53d2f5233d first vesion 2026-05-21 13:08:40 +08:00