Commit Graph

160 Commits

Author SHA1 Message Date
Xin Wang
1902ffc240 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-04 20:19:01 +08:00
Eric Wang
6957cf9b6c feat: enhance mobile call page with animated ripple effect
Added a new animation for the "开始通话" button on the mobile call page, providing a visual ripple effect to improve user experience. Adjusted layout for better clarity and responsiveness.
2026-08-04 17:31:58 +08:00
Xin Wang
74a8be2357 refactor: unify system tools as resources 2026-08-04 17:05:26 +08:00
Eric Wang
d1b05f16c7 fix: compact list pagination and refine mobile call UX
Show ellipsis page controls when lists grow large, and make mobile call start manual with clearer hangup layout and assistant name.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-04 16:53:25 +08:00
Xin Wang
731a372df9 feat: add system tools and state updates 2026-08-04 15:27:39 +08:00
Xin Wang
5bf5987fe4 feat: add prompt opening behavior modes 2026-08-04 13:29:21 +08:00
Xin Wang
78bba090a2 feat: separate prompt opening and entry behavior 2026-08-04 12:21:07 +08:00
Xin Wang
1af1cd7fed feat: trigger prompt reply after opening confirmation 2026-08-04 11:49:49 +08:00
Xin Wang
775e4058bc fix: relay confirmation interrupts past muted input 2026-08-04 11:12:34 +08:00
Xin Wang
da828aca41 Try to fix confirm and interrupt 2026-08-04 10:19:59 +08:00
Xin Wang
caa2ff65fa feat(workflow): add drawer anchor navigation 2026-08-04 09:41:52 +08:00
Xin Wang
a16ecd8e01 fix: interrupt message output before tool result 2026-08-04 09:30:52 +08:00
Xin Wang
d068927b53 feat(workflow): add floating directed edges 2026-08-04 09:22:36 +08:00
Xin Wang
c3cb410c17 fix: await message confirmation interruption 2026-08-03 17:11:43 +08:00
Xin Wang
67389fc5a1 fix: honor strict workflow agent entry mode 2026-08-03 16:34:26 +08:00
Xin Wang
06719e4801 fix: interrupt message speech on confirmation 2026-08-03 16:30:18 +08:00
Xin Wang
8064bb7152 refactor(workflow): simplify edge configuration 2026-08-03 15:17:01 +08:00
Xin Wang
dd40bfb90a feat: show client tools in debug preview 2026-08-03 14:00:33 +08:00
Xin Wang
ef434c80b2 fix(workflow): prevent fixed speech continuation 2026-08-03 13:02:31 +08:00
Xin Wang
4c43e167db feat(workflow): enhance message stages and image routing 2026-08-03 12:38:02 +08:00
Xin Wang
b0991f239e fix(frontend): clean up voice preview listeners 2026-08-03 12:30:49 +08:00
Xin Wang
841d7b8fac Update AGENTS.md 2026-08-03 10:56:30 +08:00
Xin Wang
f3439b21d1 feat: route workflow image inputs natively 2026-08-03 10:55:57 +08:00
Xin Wang
2e84de0798 feat(workflow): edit node names in drawer header 2026-08-03 10:52:25 +08:00
Xin Wang
cff591aa13 feat(frontend): embed prompt dynamic variables section 2026-08-03 10:46:56 +08:00
Xin Wang
b0f82142a5 feat(workflow): show variables in drawer 2026-08-03 09:58:01 +08:00
Xin Wang
807afb3099 feat(frontend): add top prompt anchor navigation 2026-08-03 09:56:03 +08:00
Xin Wang
02c88b36e6 feat(workflow): edit nodes on click 2026-08-03 09:52:03 +08:00
Xin Wang
f5c36a62aa feat: make workflow messages resumable 2026-08-03 07:54:51 +08:00
Xin Wang
e3035abcc2 feat(workflow): edit edges on click 2026-08-03 07:42:41 +08:00
Xin Wang
c241e815cc feat(workflow): add node duplication 2026-08-03 07:32:43 +08:00
Xin Wang
9daa46ed4d feat: add deterministic message interaction stages 2026-08-03 07:10:41 +08:00
Xin Wang
479a516546 fix: isolate startup tools and preview dialogs 2026-08-02 00:07:35 +08:00
Xin Wang
0331f8cd07 feat: add prompt startup actions and shared vision config 2026-08-01 23:31:14 +08:00
Xin Wang
b747144ff1 feat: add workflow action outcomes and tracing 2026-08-01 11:21:31 +08:00
Xin Wang
ad5ff061bb feat: add session-scoped client tool waits 2026-07-31 23:53:47 +08:00
Xin Wang
f155f98e6e feat: add workflow action runtime policies 2026-07-31 23:30:04 +08:00
Xin Wang
c2f0f5eb04 feat: add session updates and message dialogs 2026-07-31 00:01:01 +08:00
Xin Wang
913435785e feat: add configurable client tools and photo input 2026-07-30 19:06:03 +08:00
Xin Wang
510a277b5a feat(qwen-audio): enhance user transcript handling in QwenAudioRealtimeService
- Added support for managing user transcripts, including pending states and timestamps.
- Implemented methods to handle user transcript completion and deferred assistant messages.
- Updated event handling to ensure user transcripts are emitted before assistant responses.
- Enhanced tests to verify the correct order of transcript and assistant message emissions during user interactions.
2026-07-29 17:01:02 +08:00
Xin Wang
5ef376b657 refactor(workflow): streamline workflow settings management
- Introduced new utility functions `settingsFromWorkflowGraph` and `workflowGraphWithSettings` to encapsulate settings extraction and graph updates.
- Updated `useWorkflowEditorState` to utilize the new utility functions for improved clarity and maintainability.
- Refactored `AssistantPage` and `WorkflowCanvas` components to leverage the new settings management functions, ensuring consistent handling of workflow settings across the application.
- Removed redundant settings handling code, enhancing overall code cleanliness.
2026-07-29 15:09:00 +08:00
Xin Wang
774825593d feat(qwen-audio): add Alibaba Cloud Qwen-Audio Realtime service integration
- Introduced Qwen-Audio Realtime service for speech-to-speech processing in Pipecat.
- Updated interface catalog to include Qwen-Audio Realtime capabilities.
- Enhanced model resource testing to support new service.
- Added configuration options for audio sample rates and turn detection modes.
- Updated documentation to reflect integration details and usage instructions.
2026-07-21 15:57:43 +08:00
Xin Wang
f027ed99b7 feat(mcp): enhance MCP transport support and add server management UI
- Extend McpTransport to support "sse" in schemas.
- Refactor McpToolClient to handle both "streamable_http" and "sse" transports.
- Introduce McpServerDialog for managing MCP server configurations, including transport settings and tool synchronization.
- Replace McpServersSection with the new dialog component for improved server management.
- Add tests for MCP transport handling and server dialog functionality.
2026-07-19 12:04:11 +08:00
Xin Wang
c54dac403b Refactor AssistantPage to streamline agent platform handling
- Remove the draftAgentPlatform state and related logic, simplifying the creation process for assistant types.
- Default the agent platform to "dify" when creating an assistant of type "智能体平台".
- Replace the platform selection buttons with a ResourceSelectField for improved user experience and maintainability.
- Update the confirmType function to reflect the changes in platform handling.
2026-07-19 10:28:35 +08:00
Xin Wang
cd319d27b9 merge: add workflow vision configuration 2026-07-18 00:10:28 +08:00
Xin Wang
28c6380d8a feat(workflow): add per-agent vision configuration 2026-07-18 00:00:28 +08:00
Xin Wang
e39bb48ba8 feat: add MCP tool integration 2026-07-18 00:00:06 +08:00
Xin Wang
bdf3d3dd9c Refactor workflow agent and routing components for improved functionality
- Introduce WorkflowAgentStage to manage agent stage configurations and enhance interaction with the workflow engine.
- Implement WorkflowEdgeEvaluator for priority-aware edge evaluation, improving routing decisions based on conditions and user turns.
- Update WorkflowBrain to handle user turns and routing more effectively, ensuring agents cannot have only one default path.
- Enhance CallEndCoordinator to track speech events and manage call termination based on queued speech.
- Add new models and output handling for workflow interactions, improving clarity and maintainability.
- Update tests to validate the new routing logic and agent behavior under various scenarios.
2026-07-17 22:37:15 +08:00
Xin Wang
162a3d8bec Refactor workflow routing and greeting management in Brain classes
- Update WorkflowBrain to handle greeting playback more effectively, ensuring that the initial greeting completes before transitioning to the first node.
- Introduce new methods for managing greeting states and conditions, enhancing the interaction flow for user turns.
- Refactor WorkflowLLMRouter to improve routing logic and ensure proper handling of conditional paths.
- Enhance tests to verify the correct behavior of greeting management and routing under various scenarios, including waiting for audio playback to finish.
- Update frontend components to reflect changes in edge handling and improve user experience in workflow configurations.
2026-07-17 22:01:42 +08:00
Xin Wang
34c0d12d2a Refactor AssistantPage component to support agent platform integration
- Remove unused FastGpt and Dify form types, consolidating them into a single AgentPlatformForm.
- Update type definitions and state management to accommodate the new agent platform structure.
- Modify functions to handle agent platform forms and ensure proper integration with existing workflows.
- Enhance assistant type options and update related logic for improved clarity and maintainability.
2026-07-17 20:03:01 +08:00