Move system_instruction into LLMSettings
Add `system_instruction` field to `LLMSettings` so it is runtime-updatable via settings. For Google (GoogleLLMService, GoogleVertexLLMService), deprecate the init-time arg since it was already shipped. For Anthropic, AWS Bedrock, and OpenAI, remove the init-time arg entirely since it was never shipped. Add system instruction prepend logic to `build_chat_completion_params` overrides in Cerebras, SambaNova, Fireworks, Mistral, and Perplexity, which build params from scratch rather than calling `super()`. Still need to handle realtime services (OpenAI Realtime, Grok Realtime, Gemini Live).
This commit is contained in:
@@ -299,21 +299,21 @@ async def run_bot(transport: BaseTransport, runner_args: RunnerArguments):
|
||||
name="Conversation",
|
||||
settings=GoogleLLMSettings(
|
||||
model="gemini-2.5-flash",
|
||||
system_instruction=conversation_system_message,
|
||||
),
|
||||
api_key=os.getenv("GOOGLE_API_KEY"),
|
||||
# we can give the GoogleLLMService a system instruction to use directly
|
||||
# in the GenerativeModel constructor. Let's do that rather than put
|
||||
# our system message in the messages list.
|
||||
system_instruction=conversation_system_message,
|
||||
)
|
||||
|
||||
input_transcription_llm = GoogleLLMService(
|
||||
name="Transcription",
|
||||
settings=GoogleLLMSettings(
|
||||
model="gemini-2.5-flash",
|
||||
system_instruction=transcriber_system_message,
|
||||
),
|
||||
api_key=os.getenv("GOOGLE_API_KEY"),
|
||||
system_instruction=transcriber_system_message,
|
||||
)
|
||||
|
||||
messages = [
|
||||
|
||||
Reference in New Issue
Block a user