Commit Graph

67 Commits

Author SHA1 Message Date
Xin Wang
0b308f9bce Remove deprecated agent configuration files: default.yaml, example.yaml, and tools.yaml, streamlining the agent behavior setup and eliminating unused parameters. 2026-02-27 09:39:23 +08:00
Xin Wang
e14eac347f Update default.yaml configuration for speech agent parameters, adjusting min_speech_duration_ms from 100 to 120 ms and eou_threshold_ms from 800 to 1300 ms. Modify audio model parameters: set start_min_speech_ms to 100 ms, pre_speech_ms to 360 ms, and final_tail_ms to 180 ms for improved audio processing. 2026-02-27 09:00:38 +08:00
Xin Wang
fb95e2abe2 Add opener audio functionality to Assistant model and related schemas, enabling audio generation and playback features. Update API routes and frontend components to support opener audio management, including status retrieval and generation controls. 2026-02-26 14:31:50 +08:00
Xin Wang
da83c8ec8a Implement initial greeting emission in DuplexPipeline after session activation, ensuring proper event ordering for frontend notifications. 2026-02-26 14:07:46 +08:00
Xin Wang
cfc8db3fe7 Implement API URL resolution in OpenAICompatibleASRService to ensure correct endpoint handling for transcription requests. 2026-02-26 12:04:59 +08:00
Xin Wang
14b4b3d966 Implement API URL resolution for OpenAICompatibleTTSService to handle both base and full speech endpoint formats. 2026-02-26 11:07:54 +08:00
Xin Wang
8bc21c7874 Add detailed logging for session runtime configuration and service resolution 2026-02-26 11:02:15 +08:00
Xin Wang
f77f7c7531 Voice library support dashscope 2026-02-26 03:54:52 +08:00
Xin Wang
b193f91432 Set DashScope TTS default mode to commit 2026-02-26 03:10:07 +08:00
Xin Wang
562341a72c add dashscope tts 2026-02-26 03:02:48 +08:00
Xin Wang
72ed7d0512 Unify db api 2026-02-26 01:58:39 +08:00
Xin Wang
56f8aa2191 Fix talking voice error 2026-02-12 19:39:26 +08:00
Xin Wang
ff3a03b1ad Use openai compatible as vendor 2026-02-12 18:44:55 +08:00
Xin Wang
98207936ae Update .env.example 2026-02-12 17:44:38 +08:00
Xin Wang
35bd83767e Cleanup engine 2026-02-12 17:42:21 +08:00
Xin Wang
838c19bf9c Add env example 2026-02-12 17:02:41 +08:00
Xin Wang
aabf2ce8b9 Fix asr begin error 2026-02-12 16:52:42 +08:00
Xin Wang
543528239e Tune engine vad config 2026-02-12 16:29:55 +08:00
Xin Wang
a92a56b845 Presist opener to history 2026-02-12 15:59:36 +08:00
Xin Wang
399c9c97b1 Add tool call log 2026-02-12 15:44:01 +08:00
Xin Wang
6744704c7e Make get time tool use system tool 2026-02-12 15:39:09 +08:00
Xin Wang
edcbc2cec7 Add first turn option 2026-02-12 15:23:32 +08:00
Xin Wang
cbebfe1c7a Fix opener not trigger when tts disabled 2026-02-12 14:55:03 +08:00
Xin Wang
a7ef8858de Fix frontend opener showing 2026-02-12 14:46:16 +08:00
Xin Wang
ef13ddb6b2 Text drawer use generated opener 2026-02-12 14:40:22 +08:00
Xin Wang
d41db6418c Add bot not interrupt and generated opener 2026-02-12 13:51:27 +08:00
Xin Wang
4c46793169 Make server tool http based 2026-02-11 11:39:45 +08:00
Xin Wang
80e1d24443 Organize tool scheme 2026-02-11 11:22:56 +08:00
Xin Wang
9304927fe9 Import tool setting 2026-02-11 11:04:05 +08:00
Xin Wang
180a69ca67 Fix delta final priority problem in backend 2026-02-11 10:25:46 +08:00
Xin Wang
15523d9ec2 Add tts/text output schema 2026-02-11 09:50:46 +08:00
Xin Wang
2d7fc2b700 Add server tool timeout protection 2026-02-10 19:17:45 +08:00
Xin Wang
6cac24918d Now we have server tool and client tool 2026-02-10 19:13:54 +08:00
Xin Wang
4b8da32787 Update code for tool call 2026-02-10 16:28:20 +08:00
Xin Wang
539cf2fda2 Move rag to llm service 2026-02-10 13:47:08 +08:00
Xin Wang
436fb3c1e5 Tune vad min speech duration 2026-02-10 09:59:34 +08:00
Xin Wang
bbeffa89ed Update workflow feature with codex 2026-02-10 08:12:46 +08:00
Xin Wang
6b4391c423 Implement KB features with codex 2026-02-10 07:35:08 +08:00
Xin Wang
6a42c47700 Prettier EOU log 2026-02-09 19:56:47 +08:00
Xin Wang
3537a865f7 Merge branch 'master' of https://gitea.xiaowang.eu.org/wx44wx/AI-VideoAssistant 2026-02-09 19:18:24 +08:00
Xin Wang
b3e1c3d380 Use priority queue for vad event 2026-02-09 19:17:50 +08:00
Xin Wang
b34d500479 Merge branch 'master' of https://gitea.xiaowang.eu.org/wx44wx/AI-VideoAssistant 2026-02-09 18:29:56 +08:00
Xin Wang
0135f718f3 Fix asr boundary bug 2026-02-09 18:28:43 +08:00
Xin Wang
29d0b931eb better asr log 2026-02-09 18:22:00 +08:00
Xin Wang
b57d9f3a65 Fix race asr problem 2026-02-09 18:01:40 +08:00
Xin Wang
088943166c Update asr interim 2026-02-09 17:24:15 +08:00
Xin Wang
cbae28263b Merge branch 'master' of https://gitea.xiaowang.eu.org/wx44wx/AI-VideoAssistant 2026-02-09 16:30:52 +08:00
Xin Wang
29d8361ca9 Refactor duplicate stream tts adapter 2026-02-09 16:28:59 +08:00
Xin Wang
c961d63e75 Add chinese period to delimiters 2026-02-09 16:13:20 +08:00
Xin Wang
6648f1d478 Merge branch 'master' of https://gitea.xiaowang.eu.org/wx44wx/AI-VideoAssistant 2026-02-09 16:09:46 +08:00