wx44wx/pipecat
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add image input support for OpenAI Realtime

Browse Source
This commit is contained in:
Mark Backman
2026-01-06 14:11:46 -05:00
parent 8f83ba5878
commit 7ae9eebc34
3 changed files with 91 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
changelog/3360.added.md Normal file
View File

@@ -0,0 +1,6 @@
- Added image support to `OpenAIRealtimeLLMService` via `InputImageRawFrame`:
- New `start_image_paused` parameter to control initial image input state
- New `image_detail` parameter to set image processing quality ("auto", "low", or "high")
- `set_image_input_paused()` method to pause/resume image input at runtime
- `set_image_detail()` method to adjust image quality dynamically
- Automatic rate limiting (1 image per second) to prevent API overload