Xin Wang 5bc4e24adb Add vision model enhancements and image processing capabilities ...

- Update `requirements.txt` to include Pillow for image handling.
- Refactor vision model validation logic in `voice_webrtc.py` to improve error handling for unsupported image input.
- Introduce new functions in `pipeline.py` for image data processing and analysis using vision models.
- Implement `VisionCaptureProcessor` to manage video frame requests for auxiliary vision model analysis.
- Enhance the pipeline to support image input requests and integrate vision model responses into the processing flow.

2026-07-08 10:33:44 +08:00

.claude

Add support for Xfyun ASR and TTS services in the backend

2026-06-11 10:51:08 +08:00

backend

Add vision model enhancements and image processing capabilities

2026-07-08 10:33:44 +08:00

deploy

Refactor backend to support interface-definition driven model resources

2026-06-14 19:36:12 +08:00

frontend

Add vision model support and related configurations in Assistant

2026-07-07 21:50:15 +08:00

scripts

Add AI Native Static Copilot script for enhanced media handling

2026-07-08 10:06:46 +08:00

.DS_Store

Add support for image input in model resources and enhance related configurations

2026-07-07 19:41:45 +08:00

.env

Add support for image input in model resources and enhance related configurations

2026-07-07 19:41:45 +08:00

.env.example

Add WebRTC TURN configuration and related enhancements

2026-07-06 17:45:53 +08:00

AGENTS.md

Add initial setup for local HTTPS debugging and Nginx configuration

2026-06-10 13:37:24 +08:00

docker-compose.yaml

Add WebRTC TURN configuration and related enhancements

2026-07-06 17:45:53 +08:00

Makefile

Enhance Makefile and database schema for improved management

2026-07-07 22:08:42 +08:00

Description

No description provided

7.1 MiB

Languages

Python 47.3%

TypeScript 43%

JavaScript 8%

MDX 1.2%

CSS 0.3%

Other 0.1%