Add context_window_compression support to GeminiMultimodalLiveLLMService

2025-04-30 09:55:34 -04:00
parent 154d5d1859
commit d9a0a93667
3 changed files with 40 additions and 0 deletions
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -9,6 +9,11 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0

 ### Added

+- Added a `context_window_compression` InputParam to
+  `GeminiMultimodalLiveLLMService` which allows you to enable a sliding
+  context window for the session as well as set the token limit of the sliding
+  window.
+
 - Updated `SmallWebRTCConnection` to support `ice_servers` with credentials.

 - Added `VADUserStartedSpeakingFrame` and `VADUserStoppedSpeakingFrame`,