LLMContext: create_image_message/create_audio_message are now async

This commit is contained in:
Aleix Conchillo Flaqué
2025-11-18 08:38:45 -08:00
parent 6481094638
commit 9f45ad4d2e
6 changed files with 38 additions and 21 deletions

View File

@@ -28,6 +28,11 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
### Changed
- ⚠️ Breaking change: `LLMContext.create_image_message()` and
`LLMContext.create_audio_message()` are now async methods. This fixes and
issue where the asyncio event loop would be blocked while encoding audio or
images.
- `ConsumerProcessor` now queues frames from the producer internally instead of
pushing them directly. This allows us to subclass consumer processors and
manipulate frames before they are pushed.