Merge pull request #3224 from pipecat-ai/pk/simplify-gemini-thinking

Clean up logic related to applying Gemini thought signatures to conte…

changelog/3175.added.md

@@ -10,31 +10,19 @@
      - `LLMThoughtStartFrame`
      - `LLMThoughtTextFrame`
      - `LLMThoughtEndFrame`
-  3. A mechanism for appending arbitrary context messages after a function call
-     message, used specifically to support Google's function-call-related
-     "thought signatures", which are necessary to ensure thinking continuity
-     between function calls in a chain (where the model thinks, makes a function
-     call, thinks some more, etc.). See:
-     - `append_extra_context_messages` field in `FunctionInProgressFrame` and
-       helper types
-     - `GoogleLLMService` leveraging the new mechanism to add a Google-specific
-       `"fn_thought_signature"` message
-     - `LLMAssistantAggregator` handling of `append_extra_context_messages`
-     - `GeminiLLMAdapter` handling of `"fn_thought_signature"` messages
-  4. A generic mechanism for recording LLM thoughts to context, used
+  3. A generic mechanism for recording LLM thoughts to context, used
      specifically to support Anthropic, whose thought signatures are expected to
      appear alongside the text of the thoughts within assistant context
      messages. See:
      - `LLMThoughtEndFrame.signature`
      - `LLMAssistantAggregator` handling of the above field
      - `AnthropicLLMAdapter` handling of `"thought"` context messages
-  5. Google-specific logic for inserting non-function-call-related thought
-     signatures into the context, to help maintain thinking continuity in a
-     chain of LLM calls. See:
+  4. Google-specific logic for inserting thought signatures into the context,
+     to help maintain thinking continuity in a chain of LLM calls. See:
      - `GoogleLLMService` sending `LLMMessagesAppendFrame`s to add LLM-specific
-       `"non_fn_thought_signature"` messages to context
-     - `GeminiLLMAdapter` handling of `"non_fn_thought_signature"` messages
-  6. An expansion of `TranscriptProcessor` to process LLM thoughts in addition
+       `"thought_signature"` messages to context
+     - `GeminiLLMAdapter` handling of `"thought_signature"` messages
+  5. An expansion of `TranscriptProcessor` to process LLM thoughts in addition
      to user and assistant utterances. See:
      - `TranscriptProcessor(process_thoughts=True)` (defaults to `False`)
      - `ThoughtTranscriptionMessage`, which is now also emitted with the

changelog/3224.fixed.2.md

@@ -0,0 +1,3 @@
+- Better support conversation history with Gemini 2.5 Flash Image (model
+  "gemini-2.5-flash-image"). Prior to this fix, the model had no memory of
+  previous images it had generated, so it wouldn't be able to iterate on them.

changelog/3224.fixed.md

@@ -0,0 +1,3 @@
+- Support conversations with Gemini 3 Pro Image (model
+  "gemini-3-pro-image-preview"). Prior to this fix, after the model generated
+  an image the conversation would not be able to progress.