Mark Backman
357e66d64d
Input params for Together AI LLM
2024-09-20 20:21:19 -04:00
Mark Backman
4fa1ea8c4b
Input params for Anthropic LLM
2024-09-20 20:21:19 -04:00
Mark Backman
3b81cd462d
Input params to OpenAI LLM
2024-09-20 20:21:19 -04:00
Mattie Ruth
58d9c84bc9
Merge pull request #474 from pipecat-ai/ruthless/improve-metrics-types-2
...
Ruthless/improve metrics types 2
2024-09-20 09:47:24 -04:00
mattie ruth backman
a4edb3dab1
Cleanup on aisle METRICS. Note: See below, this is a breaking change
...
1. Fleshed out MetricsFrames and broke it into a proper set of types
2. Add model_name as a property to the AIService so that it can be
automatically included in metrics and also remove that
overhead from all the various services themselves
Breaking change!
Because of the types improvements, the MetricsFrame type has
changed. Each frame will have a list of metrics simlilar to before
except each item in the list will only contain one type of metric:
"ttfb", "tokens", "characters", or "processing". Previously these
fields would be in every entry but set to None if they didn't apply.
While this changes internal handling of the MetricsFrame, it does NOT
break the RTVI/daily messaging of metrics. That format remains the same.
Also. Remember to use model_name for accessing a service's current
model and set_model_name for setting it.
2024-09-19 21:30:34 -04:00
Mattie Ruth
ed409d0460
Merge pull request #478 from pipecat-ai/ruthless/get-tests-running
...
Ruthless/get tests running
2024-09-19 21:01:27 -04:00
mattie ruth backman
50b45ac2da
get the test infrastructure running again
...
disable broken tests for now
2024-09-19 20:58:17 -04:00
Kwindla Hultman Kramer
29bcbc68c5
Merge pull request #479 from pipecat-ai/khk/small-fixes
...
fix small issues that crept into main
2024-09-19 17:25:27 -07:00
Kwindla Hultman Kramer
affbe9ac7d
fix small issues that crept into main
2024-09-19 17:17:33 -07:00
Aleix Conchillo Flaqué
1790fa452f
Merge pull request #436 from pipecat-ai/aleix/frameprocessor-single-task
...
introduce synchronous and asynchronous frame processors
2024-09-19 11:22:56 -07:00
Aleix Conchillo Flaqué
607a246572
updated CHANGELOG with sync/async frame processors
2024-09-19 01:32:17 -07:00
Aleix Conchillo Flaqué
4f1b06e6b2
pipeline: renamed ParallelTask to SyncParallelPipeline
2024-09-19 01:32:17 -07:00
Aleix Conchillo Flaqué
62e9a33a70
examples: use CartesiaHttpTTSService to synchronize frames
2024-09-19 01:32:17 -07:00
Aleix Conchillo Flaqué
3298f935ef
services(fal,moondream): add missing **kwargs
2024-09-19 01:32:17 -07:00
Aleix Conchillo Flaqué
0e8f56c752
services: move TTSService push_stop_frames to AsyncTTSService
2024-09-19 01:32:15 -07:00
Aleix Conchillo Flaqué
8224538372
services(cartesia): added CartesiaHttpTTSService
2024-09-19 01:31:12 -07:00
Aleix Conchillo Flaqué
fbf6eef68f
transports(base_output): wait for sink tasks before canceling audio/video tasks
2024-09-19 01:31:12 -07:00
Aleix Conchillo Flaqué
f078d156de
frames: StartFrame is now a SystemFrame
2024-09-19 01:31:12 -07:00
Aleix Conchillo Flaqué
23d6eed5ea
transports: input()/output() return subclass instead of base class
2024-09-19 01:31:12 -07:00
Aleix Conchillo Flaqué
0ed3d118d6
services(moondream); update revision to 2024-08-26
2024-09-19 01:31:12 -07:00
Aleix Conchillo Flaqué
337f048864
introduce synchronous and asynchronous frame processors
...
Pipecat has a pipeline-based architecture. The pipeline consists of frame
processors linked to each other. The elements travelling across the pipeline are
called frames.
To have a deterministic behavior the frames travelling through the pipeline
should always be ordered, except system frames which are out-of-band frames. To
achieve that, each frame processor should only output frames from a single task.
There are synchronous and asynchronous frame processors. The synchronous
processors push output frames from the same task that they receive input frames,
and therefore only pushing frames from one task. Asynchrnous frame processors
can have internal tasks to perform things asynchrnously (e.g. receiving data
from a websocket) but they also have a single task where they push frames from.
2024-09-19 01:31:10 -07:00
Mark Backman
6f3c421621
Merge pull request #475 from pipecat-ai/mb/tts-sample-rate
...
Add sample_rate setting to TTS services
2024-09-18 14:59:09 -04:00
Mark Backman
eadd68d40b
Add sample_rate setting to TTS services
2024-09-18 14:50:20 -04:00
Aleix Conchillo Flaqué
13a4a05388
Merge pull request #466 from pipecat-ai/aleix/elevenlabs-cartesia-close-websocket-first
...
services(cartesia,elevenlabs): close websocket before the receiving task
2024-09-16 23:55:28 -07:00
Aleix Conchillo Flaqué
20c019ae16
services(cartesia,elevenlabs): close websocket before the receiving task
2024-09-16 23:54:21 -07:00
Aleix Conchillo Flaqué
d9d6571c73
Merge pull request #465 from kunal-cai/ks--fix-ws
...
[Cartesia] Fix streaming truncation bug with Twilio Fast API WS
2024-09-16 17:17:13 -07:00
Kunal Shah
540cad4844
Undo sorting
2024-09-16 16:07:19 -07:00
Kunal Shah
0a26b650c0
Undo sorting
2024-09-16 16:06:25 -07:00
Kunal Shah
adaac003e5
[Cartesia] Fix streaming truncation bug with Twilio Fast API WS
2024-09-16 15:59:06 -07:00
Aleix Conchillo Flaqué
3d4f125071
Merge pull request #454 from pipecat-ai/aleix/initial-pipeline-clock-support
...
initial pipeline clock support
2024-09-13 13:51:04 -07:00
Aleix Conchillo Flaqué
bce87f8717
update CHANGELOG.md
2024-09-13 13:50:03 -07:00
Aleix Conchillo Flaqué
1fe940bd6b
servceis(cartesia,elevenlabs): use word start times instead
2024-09-13 13:10:44 -07:00
Aleix Conchillo Flaqué
cb36a71381
fix some linting
2024-09-13 09:56:12 -07:00
Aleix Conchillo Flaqué
5acc4928fe
examples: add 07d-interruptible-elevenlabs.py
2024-09-13 09:43:18 -07:00
Aleix Conchillo Flaqué
434493b8aa
services(elevenlabs): implement word-by-word support through websockets
2024-09-13 09:31:35 -07:00
Aleix Conchillo Flaqué
f08b25dbb2
examples: assistant aggregator should always goes after transport
2024-09-12 00:37:34 -07:00
Aleix Conchillo Flaqué
3665734972
transports(output): initial sink clock synchronization
2024-09-12 00:37:34 -07:00
Aleix Conchillo Flaqué
a98d78cdea
services(lmnt): change to subclass of AsyncTTSService
2024-09-12 00:37:34 -07:00
Aleix Conchillo Flaqué
80f6d74e80
services(cartesia): change to subclass of AsyncWordTTSService
2024-09-12 00:37:34 -07:00
Aleix Conchillo Flaqué
02d926e9bd
services: create AsyncTTSService and AsyncWordTTSService
2024-09-12 00:31:48 -07:00
Aleix Conchillo Flaqué
7749692f72
processors: get pipeline clock from StartFrame
2024-09-12 00:31:48 -07:00
Aleix Conchillo Flaqué
7807cbeb39
pipeline(task): add a clock to the pipeline task
2024-09-12 00:31:48 -07:00
Aleix Conchillo Flaqué
72f231b327
frames: add a presentation timestamp (pts) to each frame
2024-09-12 00:31:48 -07:00
Aleix Conchillo Flaqué
3cbe97d346
clocks: added new BaseClock and SystemClock
2024-09-12 00:31:48 -07:00
Kwindla Hultman Kramer
b880e1a60e
Merge pull request #448 from pipecat-ai/khk/aggregation-leading-space
...
fix for leading space in context aggregator strings
2024-09-10 09:57:35 -07:00
Aleix Conchillo Flaqué
886046e696
Merge pull request #445 from dleybz/patch-1
...
Update requirements.txt
2024-09-09 17:54:33 -07:00
Aleix Conchillo Flaqué
9106a5f8ae
Merge pull request #449 from pipecat-ai/aleix/audio-out-bitrate
...
transports(daily): allow setting audio output bitrate (default 96kpbs)
2024-09-09 08:39:06 -07:00
Aleix Conchillo Flaqué
98286336bf
transports(daily): allow setting audio output bitrate (default 96kpbs)
...
Fixes #388
2024-09-08 19:39:17 -07:00
Kwindla Hultman Kramer
081b001c8b
fix for leading space in context aggregator strings
2024-09-07 16:42:52 -07:00
Danny D. Leybzon
c92531a02f
Update requirements.txt
...
request.form() throws an error if you don't have python-multipart installed
2024-09-06 20:22:18 +02:00