From 8b543e558d21e8ececd500e7198581c823505b7d Mon Sep 17 00:00:00 2001 From: Paul Kompfner Date: Mon, 25 Aug 2025 15:06:26 -0400 Subject: [PATCH] Add CHANGELOG entry describing `LLMService.run_inference()` --- CHANGELOG.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/CHANGELOG.md b/CHANGELOG.md index 412cd5754..9cf2e4fcc 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -76,6 +76,9 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0 await task.queue_frames([ManuallySwitchServiceFrame(service=llm_google)]) ``` +- Added an `LLMService.run_inference()` method to LLM services to enable + direct, out-of-band (i.e. out-of-pipeline) inference. + ### Fixed - Fixed a `CartesiaTTSService` issue that was causing the application to hang