Xin Wang
|
b5cdb76e52
|
Implement initial generated opener logic in DuplexPipeline to utilize tool-capable assistant turns when tools are available. Update tests to verify the correct behavior of the generated opener under various conditions, ensuring proper handling of user input and task management.
|
2026-03-02 02:47:30 +08:00 |
|
Xin Wang
|
4d553de34d
|
Refactor assistant greeting logic to conditionally use system prompt for generated openers. Update related tests to verify new behavior and ensure correct metadata handling in API responses. Enhance UI to reflect changes in opener management based on generated opener settings.
|
2026-03-02 02:38:45 +08:00 |
|
Xin Wang
|
1561056a3d
|
Add voice_choice_prompt and text_choice_prompt tools to API and UI. Implement state management and parameter definitions for user selection prompts, enhancing user interaction and experience.
|
2026-03-02 00:49:31 +08:00 |
|
Xin Wang
|
3643431565
|
Enhance WebSocket session configuration by introducing an optional config.resolved event, which provides a public snapshot of the session's configuration. Update the API reference documentation to clarify the conditions under which this event is emitted and the details it includes. Modify session management to respect the new setting for emitting configuration details, ensuring sensitive information remains secure. Update tests to validate the new behavior and ensure compliance with the updated configuration schema.
|
2026-03-01 23:08:44 +08:00 |
|
Xin Wang
|
6a46ec69f4
|
Enhance WebSocket session management by requiring assistant_id as a query parameter for connection. Update API reference documentation to reflect changes in message flow and metadata validation rules, including the introduction of whitelists for allowed metadata fields and restrictions on sensitive keys. Refactor client examples to align with the new session initiation process.
|
2026-03-01 14:10:38 +08:00 |
|
Xin Wang
|
b4fa664d73
|
Refactor WebSocket authentication handling by removing auth requirements from the hello message. Update related documentation and schemas to reflect the changes in authentication strategy, simplifying the connection process.
|
2026-02-28 17:33:40 +08:00 |
|
Xin Wang
|
aae41d4512
|
Clear stale ASR capture on end of utterance in DuplexPipeline. Add test to verify behavior when conversation state changes, ensuring proper handling of ASR capture variables.
|
2026-02-28 12:32:35 +08:00 |
|
Xin Wang
|
531cf6080a
|
Update DuplexPipeline tool wait timeout to 60 seconds and modify DebugDrawer to improve tool call ID handling. Ensure better integration and functionality across components.
|
2026-02-27 17:38:36 +08:00 |
|
Xin Wang
|
229243e832
|
Add wait_for_response functionality to ToolResource and related components. Update API models, schemas, and routers to support new parameter. Enhance UI components to manage wait_for_response state, ensuring proper integration across the application.
|
2026-02-27 16:54:39 +08:00 |
|
Xin Wang
|
95c6e93a9c
|
Add text_msg_prompt tool to DuplexPipeline and Assistants. Update DebugDrawer to handle text message prompts, including parameter validation and state management for displaying messages. Ensure integration with existing tools and maintain functionality across components.
|
2026-02-27 16:47:49 +08:00 |
|
Xin Wang
|
cdd8275e35
|
Add voice_message_prompt tool to API and UI components. Update DuplexPipeline, Assistants, and DebugDrawer to support new tool functionality, including parameter validation and speech synthesis integration. Ensure existing tools are preserved during seeding process in the database.
|
2026-02-27 16:04:49 +08:00 |
|
Xin Wang
|
b035e023c4
|
Implement runtime tool ID and display name mapping in DuplexPipeline. Enhance Assistants and ToolLibrary components to utilize new mappings for improved tool identification and display. Update DebugDrawer to reflect changes in tool display names during interactions.
|
2026-02-27 15:50:43 +08:00 |
|
Xin Wang
|
5f768edf68
|
Add parameter schema and defaults to ToolResource model and schemas. Implement runtime tool resolution in assistants and tools routers, ensuring proper handling of tool parameters. Update tests to validate new functionality and ensure correct integration of parameter handling in the API.
|
2026-02-27 14:44:28 +08:00 |
|
Xin Wang
|
d942c85eff
|
Add new tools to DuplexPipeline: calculator, code_interpreter, turn_on_camera, turn_off_camera, increase_volume, and decrease_volume. Implement fallback schema for unknown string tools and assign default client executors for specific tools. Update tests to validate new functionality and ensure correct tool handling in the pipeline.
|
2026-02-27 13:59:37 +08:00 |
|
Xin Wang
|
6178cc05bb
|
Add system-level dynamic variables support in session management. Implement methods to generate and apply built-in variables for current session time, UTC time, and timezone. Update documentation to reflect new variables and enhance tests for dynamic variable handling in the UI components.
|
2026-02-27 12:08:18 +08:00 |
|
Xin Wang
|
71cbfa2b48
|
Enhance DuplexPipeline and AssistantsPage for improved interruption handling. Introduce _OPENER_PRE_ROLL_MS constant for a head start on mic capture, and adjust interruption sensitivity settings from 500ms to 180ms across relevant components to optimize responsiveness during assistant interactions.
|
2026-02-27 11:51:15 +08:00 |
|
Xin Wang
|
3272a7a68a
|
Add dynamic variables support in session management and UI components. Implement validation rules for dynamic variables in metadata, including key format and value constraints. Enhance session start handling to manage dynamic variable errors. Update documentation and tests to reflect new functionality.
|
2026-02-27 11:21:37 +08:00 |
|
Xin Wang
|
f1b60bef22
|
Update ASR delta throttle timing in DuplexPipeline from 300ms to 500ms to improve processing efficiency and responsiveness.
|
2026-02-27 10:23:06 +08:00 |
|
Xin Wang
|
403b4b93c7
|
Add ASR capture timeout handling in DuplexPipeline and enhance EOU detection logic. Introduce _ASR_CAPTURE_MAX_MS constant and manage capture state timing to ensure timely end of utterance processing, even during silence. Update EouDetector to allow silence-only EOU when VAD state is lost.
|
2026-02-27 09:59:54 +08:00 |
|
Xin Wang
|
fb95e2abe2
|
Add opener audio functionality to Assistant model and related schemas, enabling audio generation and playback features. Update API routes and frontend components to support opener audio management, including status retrieval and generation controls.
|
2026-02-26 14:31:50 +08:00 |
|
Xin Wang
|
da83c8ec8a
|
Implement initial greeting emission in DuplexPipeline after session activation, ensuring proper event ordering for frontend notifications.
|
2026-02-26 14:07:46 +08:00 |
|
Xin Wang
|
8bc21c7874
|
Add detailed logging for session runtime configuration and service resolution
|
2026-02-26 11:02:15 +08:00 |
|
Xin Wang
|
562341a72c
|
add dashscope tts
|
2026-02-26 03:02:48 +08:00 |
|
Xin Wang
|
72ed7d0512
|
Unify db api
|
2026-02-26 01:58:39 +08:00 |
|
Xin Wang
|
ff3a03b1ad
|
Use openai compatible as vendor
|
2026-02-12 18:44:55 +08:00 |
|
Xin Wang
|
35bd83767e
|
Cleanup engine
|
2026-02-12 17:42:21 +08:00 |
|
Xin Wang
|
aabf2ce8b9
|
Fix asr begin error
|
2026-02-12 16:52:42 +08:00 |
|
Xin Wang
|
543528239e
|
Tune engine vad config
|
2026-02-12 16:29:55 +08:00 |
|
Xin Wang
|
a92a56b845
|
Presist opener to history
|
2026-02-12 15:59:36 +08:00 |
|
Xin Wang
|
399c9c97b1
|
Add tool call log
|
2026-02-12 15:44:01 +08:00 |
|
Xin Wang
|
6744704c7e
|
Make get time tool use system tool
|
2026-02-12 15:39:09 +08:00 |
|
Xin Wang
|
edcbc2cec7
|
Add first turn option
|
2026-02-12 15:23:32 +08:00 |
|
Xin Wang
|
cbebfe1c7a
|
Fix opener not trigger when tts disabled
|
2026-02-12 14:55:03 +08:00 |
|
Xin Wang
|
a7ef8858de
|
Fix frontend opener showing
|
2026-02-12 14:46:16 +08:00 |
|
Xin Wang
|
ef13ddb6b2
|
Text drawer use generated opener
|
2026-02-12 14:40:22 +08:00 |
|
Xin Wang
|
d41db6418c
|
Add bot not interrupt and generated opener
|
2026-02-12 13:51:27 +08:00 |
|
Xin Wang
|
4c46793169
|
Make server tool http based
|
2026-02-11 11:39:45 +08:00 |
|
Xin Wang
|
80e1d24443
|
Organize tool scheme
|
2026-02-11 11:22:56 +08:00 |
|
Xin Wang
|
9304927fe9
|
Import tool setting
|
2026-02-11 11:04:05 +08:00 |
|
Xin Wang
|
180a69ca67
|
Fix delta final priority problem in backend
|
2026-02-11 10:25:46 +08:00 |
|
Xin Wang
|
15523d9ec2
|
Add tts/text output schema
|
2026-02-11 09:50:46 +08:00 |
|
Xin Wang
|
2d7fc2b700
|
Add server tool timeout protection
|
2026-02-10 19:17:45 +08:00 |
|
Xin Wang
|
6cac24918d
|
Now we have server tool and client tool
|
2026-02-10 19:13:54 +08:00 |
|
Xin Wang
|
4b8da32787
|
Update code for tool call
|
2026-02-10 16:28:20 +08:00 |
|
Xin Wang
|
539cf2fda2
|
Move rag to llm service
|
2026-02-10 13:47:08 +08:00 |
|
Xin Wang
|
bbeffa89ed
|
Update workflow feature with codex
|
2026-02-10 08:12:46 +08:00 |
|
Xin Wang
|
6b4391c423
|
Implement KB features with codex
|
2026-02-10 07:35:08 +08:00 |
|
Xin Wang
|
6a42c47700
|
Prettier EOU log
|
2026-02-09 19:56:47 +08:00 |
|
Xin Wang
|
3537a865f7
|
Merge branch 'master' of https://gitea.xiaowang.eu.org/wx44wx/AI-VideoAssistant
|
2026-02-09 19:18:24 +08:00 |
|
Xin Wang
|
b3e1c3d380
|
Use priority queue for vad event
|
2026-02-09 19:17:50 +08:00 |
|