Paul Kompfner 26f85687d6 Handle response cancellation by draining before next inference ...

Instead of trying to filter stale events inline (unreliable — the API
doesn't provide a way to correlate events to a specific response),
drain remaining events from a cancelled response before starting the
next one. On cancellation, send response.cancel and set a drain flag.
At the start of the next _process_context, read and discard events
until a terminal event arrives, ensuring a clean connection. Falls
back to reconnecting if draining times out.

2026-03-30 09:59:03 -04:00

27 KiB

Raw Blame History

View Raw