Commit Graph

190 Commits

Author SHA1 Message Date
Ubuntu
5cb13a3cac Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-06 08:35:25 +08:00
Xin Wang
90bb27a377 fix: release input mute after async client tools 2026-08-06 00:12:34 +08:00
Ubuntu
8bd781242a fix(workflow): prevent untracked BotStoppedSpeakingFrame from consuming end-node tracked-speech counter
The CallEndCoordinator.observe() decremented _tracked_speeches on every
BotStoppedSpeakingFrame, not just the one corresponding to tracked
(end-node) speech.  When a preceding LLM utterance finished between
track_speech() and the actual fixed-speech playback, the counter was
consumed prematurely, ending the call before the end-node message played.

Gate the decrement behind a _current_speech_is_tracked flag that is set
only when BotStartedSpeakingFrame follows a pending tracked-speech start.

Co-Authored-By: Claude <noreply@anthropic.com>
2026-08-05 22:35:06 +08:00
Xin Wang
0c0a51da95 Improve image upload in debug drawer 2026-08-05 21:28:51 +08:00
Xin Wang
e36ca308b8 feat: support uploaded images in debug voice preview
Allow paste/drag temporary image assets so vision turns work without a live camera frame.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-05 19:52:37 +08:00
Xin Wang
555c8f5fa6 Merge remote-tracking branch 'origin/main' into codex/photo-history 2026-08-05 16:14:17 +08:00
Xin Wang
317a0600bc feat: persist photos and enrich conversation history 2026-08-05 16:14:03 +08:00
Eric Wang
6348ae2af6 fix(frontend): blur debug drawer chat and video behind message dialog
Use a contained dialog portal scoped to the workspace and apply direct filter blur so show_message prompts dim transcript and video reliably.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-05 15:38:41 +08:00
Eric Wang
545536bdf3 refactor(frontend): enhance MobileCallPage layout and button accessibility
Refactor the layout of the MobileCallPage component to improve structure and accessibility. Replace the Button component with a native button element, adding appropriate aria-labels and titles for better screen reader support. Adjust the positioning of elements for a more cohesive user experience.
2026-08-05 15:15:54 +08:00
Eric Wang
a9c70effae refactor(frontend): unify list and create pages with compact topbar layout
Move resource list and guide page titles into the shared topbar, introduce ListPageLayout for tighter spacing, and align knowledge edit with the prompt editor chrome.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-05 15:05:16 +08:00
Eric Wang
b27efb2892 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-05 14:36:47 +08:00
Eric Wang
7aaa1bf7c0 fix(frontend): refine editor title and section tab scrollbars
Shrink the editable assistant title in prompt/workflow editors and keep the pencil icon visible. Apply scrollbar-subtle to section anchor tabs so horizontal scrollbars match dark theme.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-05 14:36:31 +08:00
Xin Wang
0e9a1bb857 fix: cancel pipeline on peer disconnect 2026-08-05 14:34:20 +08:00
Xin Wang
0456d2b4ae Configure self-hosted STUN for remote WebRTC 2026-08-05 14:05:22 +08:00
Xin Wang
16156028c9 fix: manage WebRTC pipeline shutdown 2026-08-05 13:48:29 +08:00
Xin Wang
10bea48d72 feat: add realtime workflow vision tools 2026-08-05 13:35:00 +08:00
Xin Wang
11374238f3 fix(realtime): complete workflow message transitions 2026-08-05 11:25:50 +08:00
Eric Wang
17b5e10ed1 refactor(frontend): update SectionAnchorTabs layout and styling
- Changed the layout from equal-width grid to left-aligned flex chips for improved visual alignment.
- Adjusted the active state styling and padding for better user experience.
2026-08-05 10:15:49 +08:00
Eric Wang
71003809a2 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-05 10:00:57 +08:00
Eric Wang
aa72c522c2 feat(frontend): implement SectionAnchorTabs for improved navigation
- Replaced the existing navigation in PromptEditor and PanelAnchorNavigation with the new SectionAnchorTabs component for better code reuse and consistency.
- The SectionAnchorTabs component provides a shared interface for section navigation with equal-width columns and an active state indicator.
2026-08-05 10:00:16 +08:00
Xin Wang
3a4cb9522e Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-05 09:38:03 +08:00
Xin Wang
249dbe1fe3 Update workflow canvas 2026-08-05 09:37:43 +08:00
Xin Wang
6863567fa9 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-05 09:30:24 +08:00
Xin Wang
69736f3c51 fix(auth): align local API host with browser 2026-08-05 09:28:40 +08:00
Xin Wang
55381c5162 fix(realtime): unblock fixed speech after tool calls 2026-08-05 09:28:21 +08:00
Xin Wang
206f732d5c Add effect on debug drawer start button 2026-08-05 09:27:17 +08:00
Xin Wang
bee1e97cdb feat(frontend): compact theme selector, adaptive prompt editor layout
- Theme dropdown: 亮色/暗色/随系统 as one row of three icons
- Prompt editor: sections centered (max-w-7xl) when debug drawer is
  closed, full-width aligned with tab edges when open
- Debug drawer opens by default
- Prompt textarea: 8 → 16 rows

Co-Authored-By: Claude <noreply@anthropic.com>
2026-08-05 08:54:24 +08:00
Xin Wang
b88e37789a feat(frontend): refine app shell and assistant editors 2026-08-05 08:19:16 +08:00
Xin Wang
0ce5d9774e fix preview dialog and waveform behavior 2026-08-04 23:04:17 +08:00
Xin Wang
59588ba88d feat(workflow): add edge-tool routing and realtime runtime 2026-08-04 22:29:04 +08:00
Xin Wang
1902ffc240 Merge branch 'main' of https://gitea.xiaowang.eu.org/wx44wx/ai-video-fullstack 2026-08-04 20:19:01 +08:00
Eric Wang
6957cf9b6c feat: enhance mobile call page with animated ripple effect
Added a new animation for the "开始通话" button on the mobile call page, providing a visual ripple effect to improve user experience. Adjusted layout for better clarity and responsiveness.
2026-08-04 17:31:58 +08:00
Xin Wang
74a8be2357 refactor: unify system tools as resources 2026-08-04 17:05:26 +08:00
Eric Wang
d1b05f16c7 fix: compact list pagination and refine mobile call UX
Show ellipsis page controls when lists grow large, and make mobile call start manual with clearer hangup layout and assistant name.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-04 16:53:25 +08:00
Xin Wang
731a372df9 feat: add system tools and state updates 2026-08-04 15:27:39 +08:00
Xin Wang
5bf5987fe4 feat: add prompt opening behavior modes 2026-08-04 13:29:21 +08:00
Xin Wang
78bba090a2 feat: separate prompt opening and entry behavior 2026-08-04 12:21:07 +08:00
Xin Wang
1af1cd7fed feat: trigger prompt reply after opening confirmation 2026-08-04 11:49:49 +08:00
Xin Wang
775e4058bc fix: relay confirmation interrupts past muted input 2026-08-04 11:12:34 +08:00
Xin Wang
da828aca41 Try to fix confirm and interrupt 2026-08-04 10:19:59 +08:00
Xin Wang
caa2ff65fa feat(workflow): add drawer anchor navigation 2026-08-04 09:41:52 +08:00
Xin Wang
a16ecd8e01 fix: interrupt message output before tool result 2026-08-04 09:30:52 +08:00
Xin Wang
d068927b53 feat(workflow): add floating directed edges 2026-08-04 09:22:36 +08:00
Xin Wang
c3cb410c17 fix: await message confirmation interruption 2026-08-03 17:11:43 +08:00
Xin Wang
67389fc5a1 fix: honor strict workflow agent entry mode 2026-08-03 16:34:26 +08:00
Xin Wang
06719e4801 fix: interrupt message speech on confirmation 2026-08-03 16:30:18 +08:00
Xin Wang
8064bb7152 refactor(workflow): simplify edge configuration 2026-08-03 15:17:01 +08:00
Xin Wang
dd40bfb90a feat: show client tools in debug preview 2026-08-03 14:00:33 +08:00
Xin Wang
ef434c80b2 fix(workflow): prevent fixed speech continuation 2026-08-03 13:02:31 +08:00
Xin Wang
4c43e167db feat(workflow): enhance message stages and image routing 2026-08-03 12:38:02 +08:00