Add CHANGELOG entry describing LLMService.run_inference()

This commit is contained in:
Paul Kompfner
2025-08-25 15:06:26 -04:00
parent 8181962236
commit 8b543e558d

View File

@@ -76,6 +76,9 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
await task.queue_frames([ManuallySwitchServiceFrame(service=llm_google)])
```
- Added an `LLMService.run_inference()` method to LLM services to enable
direct, out-of-band (i.e. out-of-pipeline) inference.
### Fixed
- Fixed a `CartesiaTTSService` issue that was causing the application to hang