Add changelog entries for context summarization improvements (#3855)
This commit is contained in:
1
changelog/3855.added.2.md
Normal file
1
changelog/3855.added.2.md
Normal file
@@ -0,0 +1 @@
|
||||
- Added optional `llm` field to `LLMContextSummarizationConfig` for routing summarization to a dedicated LLM service (e.g., a cheaper/faster model) instead of the pipeline's primary model.
|
||||
1
changelog/3855.added.3.md
Normal file
1
changelog/3855.added.3.md
Normal file
@@ -0,0 +1 @@
|
||||
- Added `summarization_timeout` to `LLMContextSummarizationConfig` (default 120s) to prevent hung LLM calls from permanently blocking future summarizations.
|
||||
1
changelog/3855.added.4.md
Normal file
1
changelog/3855.added.4.md
Normal file
@@ -0,0 +1 @@
|
||||
- Added `on_summary_applied` event to `LLMContextSummarizer` for observability, providing message counts before and after context summarization.
|
||||
1
changelog/3855.added.md
Normal file
1
changelog/3855.added.md
Normal file
@@ -0,0 +1 @@
|
||||
- Added `summary_message_template` to `LLMContextSummarizationConfig` for customizing how summaries are formatted when injected into context (e.g., wrapping in XML tags).
|
||||
1
changelog/3855.changed.md
Normal file
1
changelog/3855.changed.md
Normal file
@@ -0,0 +1 @@
|
||||
- Updated context summarization to use `user` role instead of `assistant` for summary messages.
|
||||
Reference in New Issue
Block a user