diff --git a/changelog/4078.changed.md b/changelog/4078.changed.md
new file mode 100644
index 000000000..1c5882753
--- /dev/null
+++ b/changelog/4078.changed.md
@@ -0,0 +1 @@
+- Upcoming Gemini Live models don't support replacing the context during a session, so creating a single response (by using an `LLMMessagesAppendFrame` without a context manager, for example) will return an error with those models.