Paul Kompfner 9defff2a34 Skip server-known output items in previous_response_id optimization ...

When using previous_response_id, the server already knows its own
output from the previous response. Store the raw response output and,
on the next call, compare it against the items following the matched
input prefix — checking role and text content for messages, and call_id
for function calls. If the items match, skip them and send only truly
new input (user messages, tool results). Falls back to full context if
either the prefix or the output comparison fails.

2026-03-30 09:59:03 -04:00

23 KiB

Raw Blame History

View Raw