wx44wx/pipecat
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update GroqLLMService to use llama-3.3-70b-versatile as the default model

Browse Source
This commit is contained in:
Mark Backman
2025-02-08 11:25:41 -05:00
parent 32b9de5f51
commit f2b07271c1
2 changed files with 5 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
CHANGELOG.md
View File

@@ -19,6 +19,9 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
- Updated foundation example `14f-function-calling-groq.py` to use - Updated foundation example `14f-function-calling-groq.py` to use
`GroqSTTService` for transcription. `GroqSTTService` for transcription.
- Updated `GroqLLMService` to use `llama-3.3-70b-versatile` as the default
model.
- `RTVIObserver` doesn't handle `LLMSearchResponseFrame` frames anymore. For - `RTVIObserver` doesn't handle `LLMSearchResponseFrame` frames anymore. For
now, to handle those frames you need to create a `GoogleRTVIObserver` instead. now, to handle those frames you need to create a `GoogleRTVIObserver` instead.

4
src/pipecat/services/groq.py
View File

@@ -22,7 +22,7 @@ class GroqLLMService(OpenAILLMService):
Args: Args:
api_key (str): The API key for accessing Groq's API api_key (str): The API key for accessing Groq's API
base_url (str, optional): The base URL for Groq API. Defaults to "https://api.groq.com/openai/v1" base_url (str, optional): The base URL for Groq API. Defaults to "https://api.groq.com/openai/v1"
model (str, optional): The model identifier to use. Defaults to "llama-3.1-70b-versatile" model (str, optional): The model identifier to use. Defaults to "llama-3.3-70b-versatile"
**kwargs: Additional keyword arguments passed to OpenAILLMService **kwargs: Additional keyword arguments passed to OpenAILLMService
""" """
@@ -31,7 +31,7 @@ class GroqLLMService(OpenAILLMService):
*, *,
api_key: str, api_key: str,
base_url: str = "https://api.groq.com/openai/v1", base_url: str = "https://api.groq.com/openai/v1",
model: str = "llama-3.1-70b-versatile", model: str = "llama-3.3-70b-versatile",
**kwargs, **kwargs,
): ):
super().__init__(api_key=api_key, base_url=base_url, model=model, **kwargs) super().__init__(api_key=api_key, base_url=base_url, model=model, **kwargs)