Mark Backman
9ab8ddee79
Update quickstart and foundational examples to use smart-turn v3
2025-09-18 23:54:18 -04:00
Paul Kompfner
f3a4b416df
Remove VisionImageRawFrame, which was previously being handled directly by the LLM services, and deprecate the associated VisionImageFrameAggregator.
...
Removing `VisionImageRawFrame` lets us simplify LLM services' logic, getting us closer to the idealized architecture where all they care about is handling context frames.
This change is in service of getting us closer to ready to deprecate usage of `OpenAILLMContext` and subclasses in favor of the universal `LLMContext`, at least for the traditional text-to-text LLMs.
Why remove `VisionImageRawFrame` rather than deprecate? It's "internal"—only created by `VisionImageFrameAggregator`—and never intended to be used directly by users (it would be difficult to use directly anyway).
Move the logic that was once in `VisionImageFrameAggregator` directly into the examples. Reasoning:
- If `UserImageRequester` is defined in the examples, it makes sense for `UserImageProcessor` to be too, as it’s the flip side of the same coin, so to speak
- The logic is now pretty trivial
- This kind of one-shot, history-less image-describing pipeline shouldn't be common at all; it's ok for it to live in examples rather than as a dedicated class
- In the short term, this enables us to create `LLMContext`s for services that support it and `OpenAILLMContext`s for services that don't yet (AWS)
This commit also adds missing translation from OpenAI-format image context messages to AWS format. Note that this isn't a wasted effort in the face of the upcoming migration to universal `LLMContext`—this work will be reused as it has to be implemented there too.
2025-09-08 17:00:08 -04:00
Aleix Conchillo Flaqué
aeb9f1ffca
transports: reorganize module
2025-09-02 17:31:39 -07:00
Aleix Conchillo Flaqué
2b8218deaa
examples(foundational): use TTSSpeakFrame instead of TTSService.say()
2025-08-07 13:48:32 -07:00
Aleix Conchillo Flaqué
786f24c9db
examples(foundational): use RunnerArgs.pipeline_idle_timeout_secs
2025-08-06 19:38:06 -07:00
Aleix Conchillo Flaqué
66ad29b2b1
example: pass RunnerArguments to run_bot()
...
This lets us get handle_sigint from RunnerArguments which knows where the
application is running and if SIGINT/SIGTERM should be handled or not.
2025-08-05 14:38:55 -07:00
Mark Backman
f1b1d5b130
Update foundational examples to use the development runner
2025-07-31 22:11:32 -04:00
Aleix Conchillo Flaqué
ca7b0650c2
examples: capture camera or screen. allow setting framerate
2025-05-29 13:16:44 -07:00
Aleix Conchillo Flaqué
1788ba6c5c
add new pipecat.examples package and make runner public
2025-05-29 10:43:12 -07:00
Aleix Conchillo Flaqué
d476d9ea05
examples: remove "on_client_closed"
...
This has been replaced for "on_client_disconnected" in SmallWebRTCTransport to
match other transports and therefore it is not necessary anymore.
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
6393e89022
examples(foundational): update handle_signint depending on transport
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
2cdfaa0a82
examples(foundational): support multiple transports
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
a753a623d4
examples: allow setting custom program arguments
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
e79a002e5a
examples: update camera_* with video_*
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
de7185e8db
examples: remove vad_enabled=True
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
26d2ce5926
examples: remove vad_audio_passthrough=True
2025-04-24 17:14:18 -07:00
Mark Backman
f6accbd510
Updating foundation examples to use SmallWebRTCTransport and pipecat-ai-small-webrtc-prebuilt ( #1534 )
...
Co-authored-by: Filipi Fuchter <filipi@daily.co >
2025-04-11 19:44:16 -04:00
Aleix Conchillo Flaqué
7203ef6885
examples: use new services packages
2025-03-30 16:21:00 -07:00
Mark Backman
3522bbb533
tmp
2025-03-11 21:55:18 -04:00
Mark Backman
cfca7269f4
Update the Cartesia voice in all demos with one built for sonic-2
2025-03-11 21:53:03 -04:00
Aleix Conchillo Flaqué
c4dbe92b30
prefer Optional over to "| None"
2025-02-06 11:11:37 -08:00
Aleix Conchillo Flaqué
95e69597f3
update copyright keeping original year (2024)
2025-01-12 11:34:00 -08:00
Mark Backman
4667624b60
Update copyright to 2025
2025-01-06 10:19:37 -05:00
Aleix Conchillo Flaqué
17162258a2
fix ruff linter import organization
2024-12-17 11:28:58 -08:00
Aleix Conchillo Flaqué
6d11911d83
Revert "no longer necessary to call super().process_frame(frame, direction)"
2024-12-12 17:03:40 -08:00
Aleix Conchillo Flaqué
3c3fd67d96
no longer necessary to call super().process_frame(frame, direction)
2024-12-12 13:03:41 -08:00
Aleix Conchillo Flaqué
b32448e967
transports(daily): make functions async
2024-10-25 15:01:52 -07:00
Aleix Conchillo Flaqué
2a37b2459a
move vad package to audio.vad
2024-10-17 13:49:16 -07:00
Aleix Conchillo Flaqué
eeb8338dce
introduce Ruff formatting
2024-09-23 09:53:37 -07:00
Aleix Conchillo Flaqué
1a662376fc
examples: use Cartesia TTS in most examples
2024-08-19 15:31:34 -07:00
Aleix Conchillo Flaqué
4d9b7cdd61
DailyRESTHelper now receives an aiohttp client session
2024-08-01 18:08:57 -07:00
Aleix Conchillo Flaqué
27a09c0b2c
cleanup examples and remove requests library
2024-07-31 23:39:51 -07:00
Aleix Conchillo Flaqué
e765a29ca2
processors: implement base process_frame(). all subsclassed should call it
2024-06-06 10:54:21 -07:00
Aleix Conchillo Flaqué
c77db79447
examples: pipelines readability and add LLM assistants after transport
2024-05-17 14:52:51 -07:00
Aleix Conchillo Flaqué
d66a795413
examples: use SileroVADAnalyzer instead of SileroVAD
2024-05-17 14:18:55 -07:00
Aleix Conchillo Flaqué
b026915d19
initial commit for new pipecat architecture
2024-05-12 10:07:25 -07:00
Aleix Conchillo Flaqué
130e418800
moondream: allow passing use_cpu
2024-04-10 17:43:44 -07:00
Aleix Conchillo Flaqué
3c20f9153d
added VisionImageFrame and VisionImageFrameAggregator
2024-04-10 09:19:34 -07:00
Aleix Conchillo Flaqué
34a6c5691b
examples: added 12-describe-video
2024-04-09 22:36:35 -07:00
