77 Commits

Author SHA1 Message Date
Xin Wang
0928169106 Update image in camera drawer 2026-06-02 15:34:50 +08:00
Xin Wang
2348b2e5a8 Reset idle prompt on image input 2026-06-02 13:45:38 +08:00
Xin Wang
05389b1db0 Update voice demo ui language 2026-06-02 13:29:19 +08:00
Xin Wang
89d0777830 Update voice demo camera drawer 2026-06-02 13:22:08 +08:00
Xin Wang
aae751f3f3 Update voice demo language problem 2026-06-02 12:31:34 +08:00
Xin Wang
82a0cec38e Replace camera switch button with device list dropdown
The camera drawer now offers a select of available video input devices
instead of a cycle button. "使用摄像头" starts the chosen camera and
changing the dropdown switches the live stream; the list is populated
from enumerateDevices (real labels after permission is granted).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-02 10:59:03 +08:00
Xin Wang
85baf5698e Improve camera drawer UX: layout, device switching, default selection
- Grid layout for source controls: camera + switch on top row (equal
  width), upload full-width below; preview area uses aspect-ratio 4/3
- "使用摄像头" no longer changes label text; uses is-active highlight only
- "切换摄像头" now actually cycles through real video devices via
  enumerateDevices(); falls back to facingMode flip on mobile/single-cam;
  button disabled until camera is active and ≥2 devices are detected
- Default-selects first sample image when drawer opens so "拍摄完成"
  is immediately pressable without requiring a capture/upload first
- Fix: camera prompt text is now locked to CAMERA_STATE_PROMPTS[state]
  and no longer overwritten by assistant replies

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-02 10:43:18 +08:00
Xin Wang
6cf31c7062 Center camera text and bind text with state 2026-06-02 09:55:38 +08:00
Xin Wang
21f6c17388 Add image upload in conversation 2026-06-02 08:24:53 +08:00
Xin Wang
f22df60873 Update voice demo copy button 2026-06-01 09:52:09 +08:00
Xin Wang
0913f8e655 Update voice demo chat id handling 2026-06-01 09:44:44 +08:00
Xin Wang
d62c564a0d fix user transcript event ordering 2026-06-01 09:28:34 +08:00
Xin Wang
8a39461b21 fix duplicate assistant text events 2026-06-01 08:41:00 +08:00
Xin Wang
402ad81cb6 Add chatId in ws connection 2026-05-31 22:46:48 +08:00
Xin Wang
5cbfd0f0fa Refactor TTS configuration in fastgpt.state.xfyun.json: update provider, base URL, voice settings, and adjust sample rate for improved performance. 2026-05-29 16:47:07 +08:00
Xin Wang
991c8a02e7 Update idle count will reset when user active again 2026-05-29 16:44:01 +08:00
Xin Wang
050ecc7a2d Fix idle and text input race bug 2026-05-29 16:05:23 +08:00
Xin Wang
15c98f21fe Use FastGPT app opener for greetings 2026-05-29 15:34:33 +08:00
Xin Wang
ce3c384b00 Adjust user speech timeout and enhance idle prompt settings in fastgpt.state.xfyun.json and siliconflow.json 2026-05-29 13:39:17 +08:00
Xin Wang
d5e4085883 Update TTS configuration and idle prompt settings in fastgpt.state.xfyun.json and fastgpt.xfyun.supertts.json 2026-05-29 13:36:32 +08:00
Xin Wang
4c4e3e949f Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-29 12:56:47 +08:00
Xin Wang
b6cb72eda7 Remove unused config 2026-05-29 12:56:31 +08:00
Xin Wang
8319aea642 Fix idle prompt handling 2026-05-29 12:55:56 +08:00
Xin Wang
cc418e5f7e Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-29 12:37:41 +08:00
Xin Wang
ca6d263dfb Update idle to bot stop 2026-05-29 12:37:21 +08:00
Xin Wang
1e1f89906d Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-29 12:23:17 +08:00
Xin Wang
6ebb20ae50 Update idle timer 2026-05-29 12:22:55 +08:00
Xin Wang
f7df8bbda1 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-29 11:06:57 +08:00
Xin Wang
69c5941139 Update idle prompt 2026-05-29 11:01:24 +08:00
Xin Wang
d5836b75bd Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-28 15:08:57 +08:00
Xin Wang
b4804c3884 Update voice demo center text 2026-05-28 15:08:42 +08:00
Xin Wang
3bcdcced9d Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-28 15:03:46 +08:00
Xin Wang
a5839e5668 Update camera drawer font to lighter 2026-05-28 15:03:28 +08:00
Xin Wang
6ec67263bf Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-28 14:54:43 +08:00
Xin Wang
966dadda38 Add camera drawer for voice demo 2026-05-28 14:52:44 +08:00
Xin Wang
29828d5bb4 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/engine-v5-pipecat-core 2026-05-28 14:29:30 +08:00
Xin Wang
1dcfb98e63 Add set_info input event 2026-05-28 14:29:00 +08:00
Xin Wang
f954da60b4 Update voice activity detection parameters and add response state configuration in FastGPT XFYun JSON files for enhanced interaction management. 2026-05-28 13:57:33 +08:00
Xin Wang
3357585443 Add response state configuration to FastGPT XFYun JSON file, enabling state tracking with customizable parameters for improved interaction management. 2026-05-28 13:36:14 +08:00
Xin Wang
ad232fdbd9 Add configuration files for FastGPT with XFYun services, including STT, TTS, and audio filtering settings. Introduce new JSON files for different service configurations and enhance logging for text delta responses in the web application. 2026-05-28 13:28:36 +08:00
Xin Wang
2d5fd65721 Add demo page shows state code 2026-05-28 10:01:27 +08:00
Xin Wang
d94da4b4d1 Add support for prefix state code 2026-05-28 09:36:44 +08:00
Xin Wang
8c3789754f Add xfyun super tts service 2026-05-27 20:04:36 +08:00
Xin Wang
5328b90e2e Update deepfilternet readme and config 2026-05-27 16:40:21 +08:00
Xin Wang
673a54049a Add deepfilternet 2026-05-27 16:37:14 +08:00
Xin Wang
c4a53b5205 Add voice activity detection and interruption handling configurations to FastGPT and XFYun JSON files. Enhance interruption short replies with additional phrases for improved user interaction. 2026-05-26 15:45:25 +08:00
Xin Wang
7ab10eba32 Rename browser demo mount path from /demo to /voice-demo.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-26 14:37:21 +08:00
Xin Wang
d64a5315a5 update fastgpt config 2026-05-26 14:30:18 +08:00
Xin Wang
97deca0f57 Update LLM configuration to support FastGPT integration. Modify requirements to include fastgpt-python-sdk, enhance greeting messages, and adjust LLM service creation to handle app_id. Implement welcome text fetching for FastGPT and improve context handling in the pipeline based on LLM provider. Update related configurations and properties for better integration. 2026-05-26 14:15:26 +08:00
Xin Wang
3dfff0c937 Add AssistantContextSyncProcessor to manage LLM context synchronization during assistant interruptions. Update ProductTextStreamProcessor to track last streamed text and modify pipeline to integrate new context sync functionality. Enhance tests to verify context sync behavior for interrupted assistant turns. 2026-05-26 10:44:12 +08:00