wx44wx/engine-v5-pipecat-core
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
34 Commits 1 Branch 0 Tags
5328b90e2e351163188c3573784b47f4f41a49a3
Commit Graph

34 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Xin Wang
5328b90e2e Update deepfilternet readme and config 2026-05-27 16:40:21 +08:00
Xin Wang
673a54049a Add deepfilternet 2026-05-27 16:37:14 +08:00
Xin Wang
c4a53b5205 Add voice activity detection and interruption handling configurations to FastGPT and XFYun JSON files. Enhance interruption short replies with additional phrases for improved user interaction. 2026-05-26 15:45:25 +08:00
Xin Wang
7ab10eba32 Rename browser demo mount path from /demo to /voice-demo. 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-05-26 14:37:21 +08:00
Xin Wang
d64a5315a5 update fastgpt config 2026-05-26 14:30:18 +08:00
Xin Wang
97deca0f57 Update LLM configuration to support FastGPT integration. Modify requirements to include fastgpt-python-sdk, enhance greeting messages, and adjust LLM service creation to handle app_id. Implement welcome text fetching for FastGPT and improve context handling in the pipeline based on LLM provider. Update related configurations and properties for better integration. 2026-05-26 14:15:26 +08:00
Xin Wang
3dfff0c937 Add AssistantContextSyncProcessor to manage LLM context synchronization during assistant interruptions. Update ProductTextStreamProcessor to track last streamed text and modify pipeline to integrate new context sync functionality. Enhance tests to verify context sync behavior for interrupted assistant turns. 2026-05-26 10:44:12 +08:00
Xin Wang
e7a8cb1faa Enhance text stream processing by adding synchronization for interrupted assistant turns. Introduce sync_streamed_assistant_context to align LLM context with UI text, and modify ProductTextStreamProcessor to handle interrupted text. Update pipeline to utilize the new functionality for managing assistant turn interruptions. 2026-05-26 08:33:02 +08:00
Xin Wang
2edcb51805 Add chat_id, variables, detail, timeout_sec, and send_system_prompt to LLMConfig; update create_llm_service to accept new parameters and handle FastGPT integration. Modify pipeline to utilize chat_id and adjust message handling based on provider settings. 2026-05-25 08:45:30 +08:00
Xin Wang
b918eec5c1 Fix text stream frame forwarding order and transport message type. 
Push LLM/TTS frames downstream before emitting product events so the pipeline keeps correct ordering, and use OutputTransportMessageFrame instead of the urgent variant.

Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-05-24 21:56:04 +08:00
Xin Wang
f301af396d Update AGENTS.md with additional context on implementation and modify pipeline.py to include assistant aggregator in the processing flow. 2026-05-24 21:37:54 +08:00
Xin Wang
003a4abe8c Collapse high-frequency audio frames in the demo websocket log. 
Expandable groups keep protocol and text events readable while still allowing per-frame inspection when debugging audio traffic.

Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-05-23 10:21:50 +08:00
Xin Wang
5b087f8610 Add input image to product protocol 2026-05-23 08:28:56 +08:00
Xin Wang
02db9545f0 fix text input no context update 2026-05-22 21:30:54 +08:00
Xin Wang
7267c06552 Add Chinese docs for product WebSocket usage. 
Document va.ws.v1 protocol, client messages, server events, and interrupted flag behavior for product clients.

Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-05-22 15:10:15 +08:00
Xin Wang
f73fadcc77 Add interruption handling parameters to siliconflow configuration 2026-05-22 13:52:36 +08:00
Xin Wang
73f0fdf7bf Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-22 13:40:05 +08:00
Xin Wang
2c26eeff35 Update turn parameters 2026-05-22 13:38:47 +08:00
Xin Wang
75a34bf071 Add gated turn start strategy 2026-05-22 13:36:47 +08:00
Xin Wang
2c7f0f440b demo mount to fastapi 2026-05-22 10:23:17 +08:00
Xin Wang
0d82acc0d2 Remove xfyun asr interim in frontend 2026-05-22 09:40:16 +08:00
Xin Wang
dab2d0593e Update xfyun asr service 2026-05-22 08:37:31 +08:00
Xin Wang
c0fb0c51a2 Update xfyun asr streaming boundary 2026-05-22 00:06:15 +08:00
Xin Wang
2ecb3ef506 update xfyun asr 2026-05-21 20:48:24 +08:00
Xin Wang
872b8ac64a move vad config to json 2026-05-21 17:23:04 +08:00
Xin Wang
6a59df3dbd xfyun asr update one bubble 2026-05-21 17:05:20 +08:00
Xin Wang
b09ca18cb9 update bugs 2026-05-21 16:52:42 +08:00
Xin Wang
7d36735c04 Fix xfyun asr tts error 2026-05-21 16:27:24 +08:00
Xin Wang
404381c818 Add xfyun asr service 2026-05-21 15:42:49 +08:00
Xin Wang
c83c172511 Update readme 2026-05-21 14:50:39 +08:00
Xin Wang
321a4bb5bf add xfyun tts service 2026-05-21 14:48:04 +08:00
Xin Wang
f3eab5b272 Add audio logging and WebSocket enhancements to webpage 
- Introduced new state properties for audio send logging.
- Implemented functions to flush audio send logs and handle binary data sending.
- Updated WebSocket logging to differentiate between send and receive actions.
- Enhanced UI layout and styles for better responsiveness and usability.
- Improved overall structure and readability of the code.
 2026-05-21 14:25:20 +08:00
Xin Wang
092f532f51 Update webpage 2026-05-21 14:11:45 +08:00
Xin Wang
53d2f5233d first vesion 2026-05-21 13:08:40 +08:00