Add changelog entries for context summarization improvements (#3855)

This commit is contained in:
Mark Backman
2026-02-26 22:09:26 -05:00
parent 712305c5b1
commit ec9ddb3199
5 changed files with 5 additions and 0 deletions

View File

@@ -0,0 +1 @@
- Added optional `llm` field to `LLMContextSummarizationConfig` for routing summarization to a dedicated LLM service (e.g., a cheaper/faster model) instead of the pipeline's primary model.

View File

@@ -0,0 +1 @@
- Added `summarization_timeout` to `LLMContextSummarizationConfig` (default 120s) to prevent hung LLM calls from permanently blocking future summarizations.

View File

@@ -0,0 +1 @@
- Added `on_summary_applied` event to `LLMContextSummarizer` for observability, providing message counts before and after context summarization.

1
changelog/3855.added.md Normal file
View File

@@ -0,0 +1 @@
- Added `summary_message_template` to `LLMContextSummarizationConfig` for customizing how summaries are formatted when injected into context (e.g., wrapping in XML tags).

View File

@@ -0,0 +1 @@
- Updated context summarization to use `user` role instead of `assistant` for summary messages.