wx44wx/pipecat
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update Together.ai default model to openai/gpt-oss-20b

Browse Source 
The previous default (meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo) is
no longer available as a serverless Together.ai model and now requires a
custom deployment. The new default is openai/gpt-oss-20b, one of
Together's recommended models for small & fast use-cases.
This commit is contained in:
Paul Kompfner
2026-03-23 15:13:18 -04:00
parent 8c678c1c98
commit 45926a7135
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
src/pipecat/services/together/llm.py
View File

@@ -51,7 +51,7 @@ class TogetherLLMService(OpenAILLMService):
Args: Args:
api_key: The API key for accessing Together.ai's API. api_key: The API key for accessing Together.ai's API.
base_url: The base URL for Together.ai API. Defaults to "https://api.together.xyz/v1". base_url: The base URL for Together.ai API. Defaults to "https://api.together.xyz/v1".
model: The model identifier to use. Defaults to "meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo". model: The model identifier to use. Defaults to "openai/gpt-oss-20b".
.. deprecated:: 0.0.105 .. deprecated:: 0.0.105
Use ``settings=TogetherLLMService.Settings(model=...)`` instead. Use ``settings=TogetherLLMService.Settings(model=...)`` instead.
@@ -61,7 +61,7 @@ class TogetherLLMService(OpenAILLMService):
**kwargs: Additional keyword arguments passed to OpenAILLMService. **kwargs: Additional keyword arguments passed to OpenAILLMService.
""" """
# 1. Initialize default_settings with hardcoded defaults # 1. Initialize default_settings with hardcoded defaults
default_settings = self.Settings(model="meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo") default_settings = self.Settings(model="openai/gpt-oss-20b")
# 2. Apply direct init arg overrides (deprecated) # 2. Apply direct init arg overrides (deprecated)
if model is not None: if model is not None: