Merge pull request #3918 from pipecat-ai/aleix/system-instruction-openai-anthropic

Wire up system_instruction in OpenAI, Anthropic, and AWS Bedrock
This commit is contained in:
Aleix Conchillo Flaqué
2026-03-04 17:40:00 -08:00
committed by GitHub
197 changed files with 1167 additions and 1923 deletions

15
changelog/3918.added.md Normal file
View File

@@ -0,0 +1,15 @@
- Wired up `system_instruction` in `BaseOpenAILLMService`, `AnthropicLLMService`, and `AWSBedrockLLMService` so it works as a default system prompt, matching the behavior of the Google services. This enables sharing a single `LLMContext` across multiple LLM services, where each service provides its own system instruction independently.
```python
llm = OpenAILLMService(
api_key=os.getenv("OPENAI_API_KEY"),
system_instruction="You are a helpful assistant.",
)
context = LLMContext()
@transport.event_handler("on_client_connected")
async def on_client_connected(transport, client):
context.add_message({"role": "user", "content": "Please introduce yourself."})
await task.queue_frames([LLMRunFrame()])
```

1
changelog/3918.other.md Normal file
View File

@@ -0,0 +1 @@
- Updated foundational examples to use `system_instruction` on LLM services instead of adding system messages to `LLMContext`.