Commit Graph

207 Commits

Author SHA1 Message Date
Xin Wang
2f755969d3 feat(frontend): add auto test functionality to debug drawer
Introduce a new auto test mode in the debug drawer, allowing users to run automated tests with mock data. This includes the addition of AutoTestPanel, AutoTestLivePanel, and AutoTestRunBar components for managing test cases and displaying results. The debug mode can now switch between manual and auto testing, enhancing the debugging experience.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-07 16:09:18 +08:00
Xin Wang
36117b976e feat(frontend): split test assistant nav into cases and batch pages
Make 测试助手 a sidebar section like 监控观察, with placeholder routes for 测试用例 and 批量测试.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-07 16:00:50 +08:00
Xin Wang
b2e99baa19 Implement webhook 2026-08-07 14:08:49 +08:00
Xin Wang
39ee5ef96e refactor(backend): change prompt field type from varchar(8192) to text
Update the 'prompt' field in the Assistant model to use a Text type for improved flexibility. This change is accompanied by a migration script to alter the database schema accordingly.
2026-08-07 11:30:58 +08:00
Xin Wang
a9d54e7c2b feat(frontend): enhance ProfilePage with language selection and scrollable sections
Add language selection functionality and implement scrollable sections for the ProfilePage. Introduce a new SectionAnchorTabs component for navigation between Webhook and Language sections, improving user experience and organization of settings.
2026-08-07 11:28:05 +08:00
Xin Wang
bdbda8047d Add webhook to profile 2026-08-07 11:21:09 +08:00
Xin Wang
7575afaeee Splite docs to developer and user and bring profile link back 2026-08-07 11:13:45 +08:00
Xin Wang
95e04d8c94 Split Mintlify docs into user and developer sections.
Organize product guides under docs/user and setup/integration under docs/developer, with tabbed navigation for clearer audience targeting.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-07 11:09:10 +08:00
Xin Wang
56a32e81ca Add analysis feature 2026-08-07 10:59:47 +08:00
Xin Wang
485ad623d4 feat(frontend): improve history detail and model list UX
Open model resources via row click, restyle history detail with
session/analysis panels and mock playback, and theme scrollbars
globally with navy light/dark tokens.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-07 00:25:58 +08:00
Xin Wang
87b6392eea style(frontend): enhance button styling in AssistantPage
Update button styles in AssistantPage to include minimum width and padding for better layout consistency across different screen sizes.
2026-08-06 23:19:00 +08:00
Xin Wang
b51b768c29 feat(frontend): add template library and extract create-assistant page
Introduce a split-view template library for creating assistants from presets, share selection cards between create and template flows, and move the choose step out of AssistantPage into CreateAssistantPage.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-06 23:15:06 +08:00
Xin Wang
723ee84925 feat(frontend): add assistant delete menu to prompt editor topbar
Place a more-actions dropdown beside the assistant ID with confirmed delete that returns to the assistant list after removal.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-06 17:08:40 +08:00
Xin Wang
b6e2ac5765 feat(frontend): add mock post-call analysis and webhook sections to prompt editor
Introduce Analysis and Webhook section cards with local mock state so operators can configure post-call extraction fields and delivery before backend wiring.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-06 16:57:31 +08:00
Xin Wang
4d00e719c4 fix(chat): preserve user image message order 2026-08-06 13:59:59 +08:00
Xin Wang
4a07abd7fc fix(llm): adapt async tool results for compatible APIs 2026-08-06 10:22:05 +08:00
Xin Wang
aaca128f82 fix(workflow): track fixed speech at transport output 2026-08-06 10:21:36 +08:00
Ubuntu
5cb13a3cac Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-06 08:35:25 +08:00
Xin Wang
90bb27a377 fix: release input mute after async client tools 2026-08-06 00:12:34 +08:00
Ubuntu
8bd781242a fix(workflow): prevent untracked BotStoppedSpeakingFrame from consuming end-node tracked-speech counter
The CallEndCoordinator.observe() decremented _tracked_speeches on every
BotStoppedSpeakingFrame, not just the one corresponding to tracked
(end-node) speech.  When a preceding LLM utterance finished between
track_speech() and the actual fixed-speech playback, the counter was
consumed prematurely, ending the call before the end-node message played.

Gate the decrement behind a _current_speech_is_tracked flag that is set
only when BotStartedSpeakingFrame follows a pending tracked-speech start.

Co-Authored-By: Claude <noreply@anthropic.com>
2026-08-05 22:35:06 +08:00
Xin Wang
0c0a51da95 Improve image upload in debug drawer 2026-08-05 21:28:51 +08:00
Xin Wang
e36ca308b8 feat: support uploaded images in debug voice preview
Allow paste/drag temporary image assets so vision turns work without a live camera frame.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-05 19:52:37 +08:00
Xin Wang
555c8f5fa6 Merge remote-tracking branch 'origin/main' into codex/photo-history 2026-08-05 16:14:17 +08:00
Xin Wang
317a0600bc feat: persist photos and enrich conversation history 2026-08-05 16:14:03 +08:00
Eric Wang
6348ae2af6 fix(frontend): blur debug drawer chat and video behind message dialog
Use a contained dialog portal scoped to the workspace and apply direct filter blur so show_message prompts dim transcript and video reliably.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-05 15:38:41 +08:00
Eric Wang
545536bdf3 refactor(frontend): enhance MobileCallPage layout and button accessibility
Refactor the layout of the MobileCallPage component to improve structure and accessibility. Replace the Button component with a native button element, adding appropriate aria-labels and titles for better screen reader support. Adjust the positioning of elements for a more cohesive user experience.
2026-08-05 15:15:54 +08:00
Eric Wang
a9c70effae refactor(frontend): unify list and create pages with compact topbar layout
Move resource list and guide page titles into the shared topbar, introduce ListPageLayout for tighter spacing, and align knowledge edit with the prompt editor chrome.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-05 15:05:16 +08:00
Eric Wang
b27efb2892 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-05 14:36:47 +08:00
Eric Wang
7aaa1bf7c0 fix(frontend): refine editor title and section tab scrollbars
Shrink the editable assistant title in prompt/workflow editors and keep the pencil icon visible. Apply scrollbar-subtle to section anchor tabs so horizontal scrollbars match dark theme.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-05 14:36:31 +08:00
Xin Wang
0e9a1bb857 fix: cancel pipeline on peer disconnect 2026-08-05 14:34:20 +08:00
Xin Wang
0456d2b4ae Configure self-hosted STUN for remote WebRTC 2026-08-05 14:05:22 +08:00
Xin Wang
16156028c9 fix: manage WebRTC pipeline shutdown 2026-08-05 13:48:29 +08:00
Xin Wang
10bea48d72 feat: add realtime workflow vision tools 2026-08-05 13:35:00 +08:00
Xin Wang
11374238f3 fix(realtime): complete workflow message transitions 2026-08-05 11:25:50 +08:00
Eric Wang
17b5e10ed1 refactor(frontend): update SectionAnchorTabs layout and styling
- Changed the layout from equal-width grid to left-aligned flex chips for improved visual alignment.
- Adjusted the active state styling and padding for better user experience.
2026-08-05 10:15:49 +08:00
Eric Wang
71003809a2 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-05 10:00:57 +08:00
Eric Wang
aa72c522c2 feat(frontend): implement SectionAnchorTabs for improved navigation
- Replaced the existing navigation in PromptEditor and PanelAnchorNavigation with the new SectionAnchorTabs component for better code reuse and consistency.
- The SectionAnchorTabs component provides a shared interface for section navigation with equal-width columns and an active state indicator.
2026-08-05 10:00:16 +08:00
Xin Wang
3a4cb9522e Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-05 09:38:03 +08:00
Xin Wang
249dbe1fe3 Update workflow canvas 2026-08-05 09:37:43 +08:00
Xin Wang
6863567fa9 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-05 09:30:24 +08:00
Xin Wang
69736f3c51 fix(auth): align local API host with browser 2026-08-05 09:28:40 +08:00
Xin Wang
55381c5162 fix(realtime): unblock fixed speech after tool calls 2026-08-05 09:28:21 +08:00
Xin Wang
206f732d5c Add effect on debug drawer start button 2026-08-05 09:27:17 +08:00
Xin Wang
bee1e97cdb feat(frontend): compact theme selector, adaptive prompt editor layout
- Theme dropdown: 亮色/暗色/随系统 as one row of three icons
- Prompt editor: sections centered (max-w-7xl) when debug drawer is
  closed, full-width aligned with tab edges when open
- Debug drawer opens by default
- Prompt textarea: 8 → 16 rows

Co-Authored-By: Claude <noreply@anthropic.com>
2026-08-05 08:54:24 +08:00
Xin Wang
b88e37789a feat(frontend): refine app shell and assistant editors 2026-08-05 08:19:16 +08:00
Xin Wang
0ce5d9774e fix preview dialog and waveform behavior 2026-08-04 23:04:17 +08:00
Xin Wang
59588ba88d feat(workflow): add edge-tool routing and realtime runtime 2026-08-04 22:29:04 +08:00
Xin Wang
1902ffc240 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-04 20:19:01 +08:00
Eric Wang
6957cf9b6c feat: enhance mobile call page with animated ripple effect
Added a new animation for the "开始通话" button on the mobile call page, providing a visual ripple effect to improve user experience. Adjusted layout for better clarity and responsiveness.
2026-08-04 17:31:58 +08:00
Xin Wang
74a8be2357 refactor: unify system tools as resources 2026-08-04 17:05:26 +08:00