586 B
586 B
- Added an opt-in
add_tool_change_messagesflag to the LLM aggregators (set viaLLMContextAggregatorPair(..., add_tool_change_messages=True)) that appends a developer-role message to the context wheneverLLMSetToolsFramechanges the set of advertised standard tools. Helps the LLM stay coherent across mid-conversation tool changes, mitigating several flavors of tool-call-related hallucination: calling tools that have been removed, avoiding tools that have been re-added, and hallucinating output (made-up answers or tool-call-shaped non-tool-calls) when tools are unavailable.