Kwindla Hultman Kramer
681250f114
add new response frame types and vision support for anthropic
2024-05-22 21:12:30 -07:00
Aleix Conchillo Flaqué
acd2d55b84
examples(14): remove commented code
2024-05-22 19:05:18 -07:00
Aleix Conchillo Flaqué
0e5711e62d
examples: update 10-wake-work.py to use WakeCheckFilter
2024-05-22 15:44:44 -07:00
Aleix Conchillo Flaqué
0ddfa3de5b
move WakeCheckFilter to processors/filters
2024-05-22 15:44:43 -07:00
Kwindla Hultman Kramer
2c32cc2f27
improved wake word filter
2024-05-22 15:44:43 -07:00
Kwindla Hultman Kramer
66377954cb
fix up openai vision and gemini implementation
2024-05-19 12:33:57 -07:00
Kwindla Hultman Kramer
b337e984b3
Initial commit of Google Gemini LLM service.
...
Gemini text input works. We translate from OpenAILLMContext format
on the fly in the GoogleLLMService implementation. This commit also
implements image input (vision) in both the GoogleLLMService and in
the OpenAILLMService. Image input is a hack and needs to be revisited.
OpenAI expects images to be uploaded as base64-encoded JPEGs. Google
does not require the base64 encoding. Other than for images, we use
the OpenAI format as our standard, but base64-encoding the images
and then unencoding them in the GoogleLLMService feels wasteful.
2024-05-19 10:35:20 -07:00
Aleix Conchillo Flaqué
c0d5054798
examples: some prompt tweaking
2024-05-19 09:41:36 -07:00
Aleix Conchillo Flaqué
810dc30d3d
examples: fix examples to use LLMFullResponseEndFrame
2024-05-19 09:39:34 -07:00
Aleix Conchillo Flaqué
435fffe1b0
add LLMFullResponseStartFrame/LLMFullResponseEndFrame
2024-05-18 09:49:38 -07:00
Aleix Conchillo Flaqué
2b8f1c4cda
services(openai): send LLMResponseStartFrame for each completion
2024-05-17 17:47:33 -07:00
Aleix Conchillo Flaqué
c77db79447
examples: pipelines readability and add LLM assistants after transport
2024-05-17 14:52:51 -07:00
Aleix Conchillo Flaqué
d66a795413
examples: use SileroVADAnalyzer instead of SileroVAD
2024-05-17 14:18:55 -07:00
Aleix Conchillo Flaqué
a5d246ec0c
vad: use exponential smoothing to avoid sudden changes
2024-05-17 13:53:33 -07:00
Aleix Conchillo Flaqué
f432e2b17e
transports: allow adding a vad analyzer to BaseInputTransport
2024-05-17 13:50:48 -07:00
Aleix Conchillo Flaqué
8c877d7d8e
examples: update 07-interruptible
2024-05-17 13:50:48 -07:00
Aleix Conchillo Flaqué
8965ff27ec
examples: use DEBUG in 09-mirror.py
2024-05-14 19:25:31 -07:00
Aleix Conchillo Flaqué
f6257a86d3
examples: re-enable audio in 09-mirror.py
2024-05-14 19:23:35 -07:00
Aleix Conchillo Flaqué
bd04ea8aca
examples: simplify 09-mirror.py
2024-05-14 19:07:19 -07:00
Aleix Conchillo Flaqué
b254525d3c
go back to using @dataclass since they can be inspected
2024-05-12 22:35:43 -07:00
Aleix Conchillo Flaqué
bfd583211c
examples: use LocalAudioTransport
2024-05-12 10:07:54 -07:00
Aleix Conchillo Flaqué
b026915d19
initial commit for new pipecat architecture
2024-05-12 10:07:25 -07:00
Aleix Conchillo Flaqué
7b49c9ade3
services: FalImageGenService now uses fal-client library
2024-04-11 14:09:01 -07:00
Aleix Conchillo Flaqué
1e83a405c0
Merge pull request #117 from daily-co/llm-use-aggregator-pass-through-fix
...
aggregators: fix LLMUserResponseAggregator passs-through
2024-04-12 04:24:56 +08:00
Aleix Conchillo Flaqué
7336866a1c
examples: rely on new daily default transcription settings
2024-04-11 11:22:58 -07:00
Aleix Conchillo Flaqué
e288aa047b
examples: use LLMUserResponseAggregator with VAD
2024-04-11 08:10:56 -07:00
Aleix Conchillo Flaqué
130e418800
moondream: allow passing use_cpu
2024-04-10 17:43:44 -07:00
Aleix Conchillo Flaqué
1a0a66e503
Merge pull request #114 from daily-co/jpt/fal-updates
...
Updated Fal.ai service to take a params model and allow for model string param
2024-04-11 00:47:33 +08:00
Aleix Conchillo Flaqué
e22babbae2
examples: update with new FalImageGenService parameters
2024-04-10 09:45:08 -07:00
Aleix Conchillo Flaqué
3c20f9153d
added VisionImageFrame and VisionImageFrameAggregator
2024-04-10 09:19:34 -07:00
Aleix Conchillo Flaqué
34a6c5691b
examples: added 12-describe-video
2024-04-09 22:36:35 -07:00
Aleix Conchillo Flaqué
9fcbb36997
examples: add 14a-local-render-remote-participant
2024-04-09 19:46:10 -07:00
Aleix Conchillo Flaqué
8d73cdb2ee
Merge pull request #111 from daily-co/user-transcription-aggregator
...
pipeline: add UserTranscriptionAggregator
2024-04-09 23:34:52 +08:00
Aleix Conchillo Flaqué
97b923e37e
llm user and assistant aggregator renames
2024-04-09 08:31:48 -07:00
Aleix Conchillo Flaqué
57aabea0a3
examples: added 14-render-remote-participant
2024-04-09 08:01:14 -07:00
Aleix Conchillo Flaqué
319b8e7816
updated ImageFrame and added URLImageFrame and UserImageFrame
2024-04-08 23:23:33 -07:00
Aleix Conchillo Flaqué
96950ca6df
daily: on_first_other_participant_joined now gets the participant
2024-04-08 23:23:33 -07:00
Aleix Conchillo Flaqué
497a09cbc8
examples: updated to_be_updated examples
2024-04-05 16:01:23 -07:00
Aleix Conchillo Flaqué
9590cc2fbc
examples: fix whisper examples
2024-04-05 13:43:51 -07:00
Aleix Conchillo Flaqué
1ea503c1e6
examples: fix 03a-image-local
2024-04-04 15:35:58 -07:00
Aleix Conchillo Flaqué
982c0a0749
examples: move non-working examples to to_be_updated
2024-04-04 14:04:53 -07:00
Moishe Lettvin
27322108b7
Cleanup the last few badly-named Frame types
2024-03-28 12:36:24 -04:00
Moishe Lettvin
565acfa9c9
Merge pull request #86 from daily-co/transport-refactor
...
Starting refactor of transports into their own directory
2024-03-28 11:17:32 -04:00
Moishe Lettvin
5c0ba1b6f0
Fix off by one errors, add tests and comment
2024-03-28 08:34:34 -04:00
James Hush
a3293c6d7a
fix: force overriding environment variables from .env files ( #89 )
2024-03-27 23:38:55 +08:00
Moishe Lettvin
2fc5de6afe
Starting refactor of transports into their own directory
2024-03-26 08:35:04 -04:00
Moishe Lettvin
2bda4c3307
Websocket transport
2024-03-25 13:54:34 -04:00
Aleix Conchillo Flaqué
8f9aeb0751
Merge pull request #82 from daily-co/remove-unused-imports
...
remove unused imports
2024-03-22 03:02:07 +08:00
Aleix Conchillo Flaqué
cf5d516d51
use OPENAI_API_KEY instead of OPENAI_CHATGPT_API_KEY
...
Fixes #77
2024-03-20 15:26:32 -07:00
Aleix Conchillo Flaqué
0666dd1194
remove unused imports
2024-03-20 14:52:19 -07:00
