Changelog entries for context summarization
This commit is contained in:
1
changelog/3621.added.2.md
Normal file
1
changelog/3621.added.2.md
Normal file
@@ -0,0 +1 @@
|
||||
- Added new frames for context summarization: `LLMContextSummaryRequestFrame` and `LLMContextSummaryResultFrame`.
|
||||
5
changelog/3621.added.md
Normal file
5
changelog/3621.added.md
Normal file
@@ -0,0 +1,5 @@
|
||||
- Added context summarization feature to automatically compress conversation history when conversation length limits (by token or message count) are reached, enabling efficient long-running conversations.
|
||||
- Configure via `enable_context_summarization=True` in `LLMAssistantAggregatorParams`
|
||||
- Customize behavior with `LLMContextSummarizationConfig` (max tokens, thresholds, etc.)
|
||||
- Automatically preserves incomplete function call sequences during summarization
|
||||
- See new examples: `examples/foundational/54-context-summarization-openai.py` and `examples/foundational/54a-context-summarization-google.py`
|
||||
Reference in New Issue
Block a user