Commit Graph

12 Commits

Author SHA1 Message Date
Xin Wang
03478fa557 Add Audio Sender Sine Tester script for WebRTC audio management
- Introduce a new user script `audio-sender-sine-tester.js` that lists current WebRTC audio senders and allows temporary sine wave transmission through selected senders.
- Implement functionality for managing audio sender candidates, tracking audio statistics, and providing real-time logging of audio activities.
- Enhance audio testing capabilities with sine wave generation and track replacement features, improving overall audio management in the WebRTC environment.
- This addition supports better monitoring and testing of audio streams in applications utilizing WebRTC.
2026-07-09 13:33:02 +08:00
Xin Wang
68931c9266 Remove AI Native Element and Static Copilot scripts
- Delete the user scripts `copilot-native-element.js` and `copilot-native-static.js` that implemented native-track bridges for audio and video input selection in WebRTC.
- These scripts provided functionalities for managing remote audio and video tracks, recording capabilities, and chat logging features for AI interactions.
- The removal is part of a refactoring effort to streamline the codebase and improve overall media management.
2026-07-09 09:41:25 +08:00
Xin Wang
1e1b5d84d4 Add Video Track Probe script for enhanced video monitoring
- Introduce a new user script `video-track-probe.js` that probes WebRTC video input/output tracks and displays active RTP statistics.
- Implement functionality to manage video track candidates, including live video detection and performance metrics.
- Enhance logging features to provide real-time feedback on video track status and statistics.
- Integrate mechanisms for tracking video elements and their associated media streams, improving overall media management in the WebRTC environment.
2026-07-09 09:41:10 +08:00
Xin Wang
d3661adf46 Add Audio Track Probe script for enhanced audio monitoring
- Introduce a new user script `audio-track-probe.js` that probes WebRTC audio input/output tracks and displays active RTP statistics.
- Implement functionality to manage audio track candidates, including live audio detection and audio level analysis.
- Enhance logging features to provide real-time feedback on audio track status and metrics.
- Integrate audio context management for improved audio visualization and monitoring capabilities.
2026-07-09 09:39:38 +08:00
Xin Wang
fe443932f0 Refactor AI Element2 Gated Copilot script for improved audio handling
- Update the description to clarify that participant audio is fed into AI after both sides are connected.
- Introduce new functions to manage audio track patterns and enhance the logic for determining participant and operator presence.
- Improve gate status messaging to reflect the online status of participants and operators.
- Add volume handling functions for better audio visualization and feedback.
- Refactor existing functions to streamline audio processing and improve overall code clarity.
2026-07-09 08:54:15 +08:00
Xin Wang
4601aeab75 Add AI Element2 Gated Copilot script for enhanced media interaction
- Introduce a new user script `copilot-element2-two-party.js` that implements a two-party gated bridge for audio input to AI, ensuring both sides are connected before processing.
- Implement functionality for managing audio and video tracks, including recording capabilities for AI input.
- Enhance chat logging features to provide real-time feedback on AI interactions and recording status.
- Integrate mechanisms for handling media streams, improving overall media management in the WebRTC environment.
2026-07-09 08:41:57 +08:00
Xin Wang
0ce7beb581 Add AI Native Direct Output script for enhanced media interaction
- Introduce a new user script `copilot-native-direct-output.js` that facilitates direct AI response track output to business senders.
- Implement functionality for managing audio and video tracks, including recording capabilities for AI input.
- Enhance chat logging features to provide real-time feedback on AI interactions and recording status.
- Integrate mechanisms for handling media streams, improving overall media management in the WebRTC environment.
2026-07-08 23:24:32 +08:00
Xin Wang
cebc62bdfb Add AI Native Track Copilot script for enhanced media interaction
- Introduce a new user script `copilot-native.js` that implements a native-track bridge for audio and video input selection in WebRTC.
- Implement functionality for managing remote audio and video tracks, including recording capabilities for AI input.
- Enhance chat logging features to provide real-time feedback on AI interactions and recording status.
- Integrate mechanisms for handling media streams, improving overall media management in the WebRTC environment.
2026-07-08 14:53:29 +08:00
Xin Wang
ea52f422a9 Add AI Native Element Copilot script for enhanced media interaction
- Introduce a new user script `copilot-native-element.js` that implements a native-track bridge for audio and video input selection in WebRTC.
- Implement functionality for managing remote audio and video tracks, including recording capabilities for AI input.
- Enhance chat logging features to provide real-time feedback on AI interactions and recording status.
- Integrate mechanisms for handling media streams, improving overall media management in the WebRTC environment.
2026-07-08 13:50:47 +08:00
Xin Wang
b428f1b8cf Add AI Native Static Copilot script for enhanced media handling
- Introduce a new user script `copilot-native-static.js` that implements a native-track bridge with static input/output selection rules for WebRTC.
- Implement functionality for managing remote audio and video tracks, including recording capabilities for AI input.
- Enhance chat logging features to provide real-time feedback on AI interactions and recording status.
- Integrate mechanisms for handling media streams and improve overall media management in the WebRTC environment.
2026-07-08 10:06:46 +08:00
Xin Wang
97ac7ef79e Add video stream capture functionality in copilot.js
- Introduce a new function to capture video streams from playable HTML elements, enhancing the ability to process remote video feeds.
- Implement logic to manage and store captured video streams, ensuring only live tracks are utilized.
- Update existing audio processing functions to integrate video handling, improving overall media management in the WebRTC environment.
- Enhance logging for better debugging and user feedback regarding video stream capture status.
2026-07-08 00:40:57 +08:00
Xin Wang
32a52d318a Add AI Copilot WebRTC script for enhanced audio processing and monitoring
- Introduce a new user script `copilot.js` for WebRTC that implements PCM ScriptProcessor to address packet loss issues.
- Add features for real-time audio monitoring and improved audio stream handling, including mechanisms for capturing and processing remote audio streams.
- Implement a robust audio context setup with gain nodes and oscillators for enhanced audio management.
- Enhance logging and state management for better debugging and monitoring of audio streams in the WebRTC environment.
2026-07-07 16:22:51 +08:00