Xin Wang
2348b2e5a8
Reset idle prompt on image input
2026-06-02 13:45:38 +08:00
Xin Wang
21f6c17388
Add image upload in conversation
2026-06-02 08:24:53 +08:00
Xin Wang
d62c564a0d
fix user transcript event ordering
2026-06-01 09:28:34 +08:00
Xin Wang
8a39461b21
fix duplicate assistant text events
2026-06-01 08:41:00 +08:00
Xin Wang
402ad81cb6
Add chatId in ws connection
2026-05-31 22:46:48 +08:00
Xin Wang
991c8a02e7
Update idle count will reset when user active again
2026-05-29 16:44:01 +08:00
Xin Wang
050ecc7a2d
Fix idle and text input race bug
2026-05-29 16:05:23 +08:00
Xin Wang
15c98f21fe
Use FastGPT app opener for greetings
2026-05-29 15:34:33 +08:00
Xin Wang
8319aea642
Fix idle prompt handling
2026-05-29 12:55:56 +08:00
Xin Wang
ca6d263dfb
Update idle to bot stop
2026-05-29 12:37:21 +08:00
Xin Wang
6ebb20ae50
Update idle timer
2026-05-29 12:22:55 +08:00
Xin Wang
69c5941139
Update idle prompt
2026-05-29 11:01:24 +08:00
Xin Wang
1dcfb98e63
Add set_info input event
2026-05-28 14:29:00 +08:00
Xin Wang
d94da4b4d1
Add support for prefix state code
2026-05-28 09:36:44 +08:00
Xin Wang
8c3789754f
Add xfyun super tts service
2026-05-27 20:04:36 +08:00
Xin Wang
673a54049a
Add deepfilternet
2026-05-27 16:37:14 +08:00
Xin Wang
7ab10eba32
Rename browser demo mount path from /demo to /voice-demo.
...
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-05-26 14:37:21 +08:00
Xin Wang
97deca0f57
Update LLM configuration to support FastGPT integration. Modify requirements to include fastgpt-python-sdk, enhance greeting messages, and adjust LLM service creation to handle app_id. Implement welcome text fetching for FastGPT and improve context handling in the pipeline based on LLM provider. Update related configurations and properties for better integration.
2026-05-26 14:15:26 +08:00
Xin Wang
3dfff0c937
Add AssistantContextSyncProcessor to manage LLM context synchronization during assistant interruptions. Update ProductTextStreamProcessor to track last streamed text and modify pipeline to integrate new context sync functionality. Enhance tests to verify context sync behavior for interrupted assistant turns.
2026-05-26 10:44:12 +08:00
Xin Wang
e7a8cb1faa
Enhance text stream processing by adding synchronization for interrupted assistant turns. Introduce sync_streamed_assistant_context to align LLM context with UI text, and modify ProductTextStreamProcessor to handle interrupted text. Update pipeline to utilize the new functionality for managing assistant turn interruptions.
2026-05-26 08:33:02 +08:00
Xin Wang
2edcb51805
Add chat_id, variables, detail, timeout_sec, and send_system_prompt to LLMConfig; update create_llm_service to accept new parameters and handle FastGPT integration. Modify pipeline to utilize chat_id and adjust message handling based on provider settings.
2026-05-25 08:45:30 +08:00
Xin Wang
b918eec5c1
Fix text stream frame forwarding order and transport message type.
...
Push LLM/TTS frames downstream before emitting product events so the pipeline keeps correct ordering, and use OutputTransportMessageFrame instead of the urgent variant.
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-05-24 21:56:04 +08:00
Xin Wang
f301af396d
Update AGENTS.md with additional context on implementation and modify pipeline.py to include assistant aggregator in the processing flow.
2026-05-24 21:37:54 +08:00
Xin Wang
5b087f8610
Add input image to product protocol
2026-05-23 08:28:56 +08:00
Xin Wang
02db9545f0
fix text input no context update
2026-05-22 21:30:54 +08:00
Xin Wang
75a34bf071
Add gated turn start strategy
2026-05-22 13:36:47 +08:00
Xin Wang
2c7f0f440b
demo mount to fastapi
2026-05-22 10:23:17 +08:00
Xin Wang
dab2d0593e
Update xfyun asr service
2026-05-22 08:37:31 +08:00
Xin Wang
c0fb0c51a2
Update xfyun asr streaming boundary
2026-05-22 00:06:15 +08:00
Xin Wang
2ecb3ef506
update xfyun asr
2026-05-21 20:48:24 +08:00
Xin Wang
872b8ac64a
move vad config to json
2026-05-21 17:23:04 +08:00
Xin Wang
6a59df3dbd
xfyun asr update one bubble
2026-05-21 17:05:20 +08:00
Xin Wang
b09ca18cb9
update bugs
2026-05-21 16:52:42 +08:00
Xin Wang
7d36735c04
Fix xfyun asr tts error
2026-05-21 16:27:24 +08:00
Xin Wang
404381c818
Add xfyun asr service
2026-05-21 15:42:49 +08:00
Xin Wang
321a4bb5bf
add xfyun tts service
2026-05-21 14:48:04 +08:00
Xin Wang
53d2f5233d
first vesion
2026-05-21 13:08:40 +08:00
