Paul Kompfner
b6a1886dae
Update OpenAIRealtimeLLMService to work with LLMContext and LLMContextAggregatorPair (cont'd).
2025-10-29 15:43:51 -04:00
Paul Kompfner
42d0a097c5
Tweaks to 20b example
2025-10-29 15:43:51 -04:00
Paul Kompfner
46e97c57c2
Update OpenAIRealtimeLLMService to work with LLMContext and LLMContextAggregatorPair (cont'd).
...
Update 20b example to use new `LLMContext` pattern.
2025-10-29 15:43:51 -04:00
Paul Kompfner
5fa56df014
Update OpenAIRealtimeLLMService to work with LLMContext and LLMContextAggregatorPair (cont'd).
...
Update 19b example with new pattern.
2025-10-29 15:36:58 -04:00
Paul Kompfner
ec42f8c24e
Update OpenAIRealtimeLLMService to work with LLMContext and LLMContextAggregatorPair (cont'd).
...
Push `TranscriptionFrame`s upstream, to be handled by the user context aggregator. This will require at least a couple of other changes:
- Updating examples to put transcript processors upstream from `OpenAIRealtimeLLMService`
- Maybe figuring out a way to preserve backward compatibility with existing pipelines that put transcript processors downstream from `OpenAIRealtimeLLMService`
- Updating `OpenAIRealtimeLLMService` to ignore new received context frames, since the upstream user context aggregator will generate those after each newly-added user message; hopefully nobody was reliant on the old behavior of resetting the conversation upon receiving a new context!
2025-10-29 15:36:57 -04:00
Paul Kompfner
3ea1e357f2
Update OpenAIRealtimeLLMService to work with LLMContext and LLMContextAggregatorPair (initial part of work)
2025-10-29 15:36:57 -04:00
kompfner
351ef617ae
Merge pull request #2932 from pipecat-ai/pk/gemini-live-universal-llmcontext
...
Update `GeminiLLMService` to work with `LLMContext` and `LLMContextAg…
2025-10-29 15:35:13 -04:00
Paul Kompfner
82d494d3d4
Fix a bug in GeminiLiveLLMService related to ending gracefully—i.e. waiting for the bot to stop responding before ending the pipeline—when the service is configured with the TEXT modality
2025-10-29 14:34:02 -04:00
Mark Backman
ede6c32149
Update Simli to align with Pipecat constructor norms
2025-10-29 11:47:23 -04:00
Paul Kompfner
f974c66e12
Update GeminiLLMService to work with LLMContext and LLMContextAggregatorPair
2025-10-28 15:46:28 -04:00
Mark Backman
ec890a834f
Rename to filter_system_frames
2025-10-22 11:01:33 -04:00
Mark Backman
5b921fc054
fix: FunctionFilter adds block_system_frame arg
2025-10-22 10:53:01 -04:00
Mark Backman
5849485bc6
fix: AWSBedrockLLMService compatibility for newer Claude models
2025-10-21 19:47:27 -04:00
vipyne
23385ca3d2
replace foundational example 08-bots-arguing.py with 08-custom-frame-processor.py
2025-10-21 11:56:35 -05:00
vipyne
8b24bae9c5
pr notes
2025-10-21 11:42:06 -05:00
vipyne
abf0150261
add 47-custom-frame-processor.py to foundational examples
2025-10-20 12:11:40 -05:00
Paul Kompfner
860c39d1b1
Get rid of LLMContext.get_messages_for_persistent_storage().
...
The reason for its `system_instruction` argument was to support usage with LLMs where you might pass the system instruction as a parameter to the `LLMService` rather than specifying it in the context.
But as I thought about it more I became unconvinced that the `system_instruction` argument was really beneficial:
- If you specified your system instruction in your context in the first place, it'll still be there when you read messages for persistent storage
- If you didn't specify your system instruction in the context and instead passed it in as an `LLMService` parameter, you most likely *don't* want it to be in the context when you read messages for persistent storage
- ...and if you really really do need to inject it at the start of the context, it's quite easy to do anyway
And if we remove the `system_instruction` argument from `get_messages_for_persistent_storage()`, then it's essentially just `get_messages()`.
2025-10-20 09:49:05 -04:00
Paul Kompfner
ae5c5ed7f6
Update AWSNovaSonicLLMService to work with LLMContext and LLMContextAggregatorPair
2025-10-20 09:49:00 -04:00
Mark Backman
8902f1dc94
Bump openai, openpipe versions, add 14x foundational example
2025-10-15 15:17:22 -04:00
Mark Backman
82c7d7ad83
Merge pull request #2867 from pipecat-ai/mb/update-moondream-readme
...
Update moondream chatbot README link
2025-10-15 15:16:19 -04:00
Mark Backman
ba2ab51ef7
Merge pull request #2866 from pipecat-ai/mb/add-sentry-foundational
...
Add foundation 47-sentry-metrics.py
2025-10-15 15:15:52 -04:00
Mark Backman
e11ede475b
Update moondream chatbot README link
2025-10-15 13:22:56 -04:00
Aleix Conchillo Flaqué
abc569b3d2
examples(foundational/07): use CartesiaSTTService
2025-10-15 09:46:57 -07:00
Mark Backman
fa5d4ecf86
Add foundation 47-sentry-metrics.py
2025-10-15 12:45:07 -04:00
Paul Kompfner
55014bdd77
Update a Google Vertex disclaimer for accuracy
2025-10-10 13:18:03 -04:00
Paul Kompfner
1c25b6fb72
location should not be optional when using Google Vertex.
...
Also, update `GoogleVertexLLMService` initialization pattern in the example file.
2025-10-10 12:58:45 -04:00
Mark Backman
4b415721e2
Update release evals for OpenAI Realtime, Gemini Live Vertex; shorten 26 foundational names
2025-10-10 12:26:23 -04:00
Aleix Conchillo Flaqué
1f6b61c0db
Merge pull request #2828 from pipecat-ai/aleix/gemini-live-gemini-to-llm
...
google: rename google.gemini_live.gemini to google.gemini_live.llm
2025-10-10 06:42:51 -07:00
Aleix Conchillo Flaqué
8ee28b37cd
google: rename google.gemini_live.vertext to google.gemini_live.llm_vertex
2025-10-10 06:41:19 -07:00
Filipi Fuchter
1b3afb5511
Added audio filter KrispVivaFilter using the Krisp VIVA SDK
2025-10-10 09:44:47 -03:00
Aleix Conchillo Flaqué
7cec013666
google: rename google.gemini_live.gemini to google.gemini_live.llm
2025-10-09 22:20:09 -07:00
Aleix Conchillo Flaqué
9935a68018
examples(19b): fix deprecations
2025-10-09 22:14:52 -07:00
Aleix Conchillo Flaqué
7b05c9283b
move openai.realtime.azure to azure.realtime.llm
2025-10-09 22:14:46 -07:00
Aleix Conchillo Flaqué
303dd2ec35
move openai.realtime.openai to openai.realtime.llm
2025-10-09 22:14:46 -07:00
Aleix Conchillo Flaqué
aa6e81648a
move openai_realtime to openai.realtime
2025-10-09 22:14:46 -07:00
Aleix Conchillo Flaqué
15bf5b1533
aws: move aws_nova_sonic to aws.nova_sonic
2025-10-09 17:35:47 -07:00
Aleix Conchillo Flaqué
aeace9b9be
google: move gemini_live inside google service
2025-10-09 16:06:42 -07:00
Paul Kompfner
f2d9063984
Renames: remove "multimodal" from Gemini Live types
2025-10-09 10:58:36 -04:00
Paul Kompfner
99f008e927
Make a note in our examples that there's an issue with Gemini Live + Vertex around specifying a modality other than AUDIO
2025-10-08 21:03:07 -04:00
Paul Kompfner
0b6dd98000
Make a note in our examples that there's an issue with Gemini Live + Vertex around using "google_search" alongside other tools
2025-10-08 21:03:07 -04:00
Paul Kompfner
728361a6a7
Add GeminiVertexMultimodalLiveLLMService
2025-10-08 21:03:01 -04:00
Paul Kompfner
a666327d70
Implement ending GeminiMultimodalLiveLLMService gracefully (i.e. after the bot is finished)
2025-10-08 17:13:04 -04:00
Mark Backman
4b2379cba8
Merge pull request #2798 from ivaaan/hume-rtvi
...
Hume add RTVI
2025-10-07 21:20:50 -04:00
Mark Backman
7bbdb4f991
Remove deprecation warning for ElevenLabsSTTService
2025-10-07 12:32:32 -04:00
ivaaan
f38f4711ac
wip
2025-10-06 20:24:27 -07:00
ivaaan
c2f3ddd329
add RTVI to Hume
2025-10-06 19:41:31 -07:00
ivaaan
73ffe96228
add RTVI to Hume
2025-10-06 19:37:05 -07:00
Aleix Conchillo Flaqué
fe168e3c68
GoogleLLMService: added support for image generation
2025-10-06 17:38:08 -07:00
Mark Backman
60604a9449
Tidying up the Hume example and service
2025-10-02 17:34:40 -04:00
ivaaan
c1492c5275
fixes based on markbackman review
2025-10-02 13:38:36 -07:00
