Aleix Conchillo Flaqué
0b691ff597
Merge pull request #198 from pipecat-ai/aleix/websocket-transport
...
websocket transport support
2024-06-01 04:40:39 +08:00
Aleix Conchillo Flaqué
0d6eee705f
Merge pull request #190 from TomTom101/TomTom101/langchain
...
Langchain service
2024-06-01 04:21:12 +08:00
Aleix Conchillo Flaqué
38befe1dc1
examples(websocket): rename server.py to bot.py
2024-05-31 12:09:54 -07:00
Aleix Conchillo Flaqué
3fef818843
examples(websocket-server): use VAD analyzer from transport
2024-05-31 11:54:18 -07:00
Aleix Conchillo Flaqué
66c6a5dc0f
transports(websocket): base class from BaseOutputTransport
2024-05-31 11:37:43 -07:00
Aleix Conchillo Flaqué
7b8b606278
update CHANGELOG and create websocker-server instructions
2024-05-31 11:37:19 -07:00
Aleix Conchillo Flaqué
7116ad0607
examples: fix websocket-client audio playback
2024-05-31 11:36:52 -07:00
Aleix Conchillo Flaqué
c507044277
examples: use gpt-4o model by default
2024-05-31 11:36:52 -07:00
Aleix Conchillo Flaqué
5f45a9d90f
examples: websocket-server updates
2024-05-31 11:36:52 -07:00
Aleix Conchillo Flaqué
2957416d90
serializers(protobuf): support id and name fields
2024-05-31 11:36:52 -07:00
Aleix Conchillo Flaqué
b9b761b67a
added sample_rate and num_channels to protobuf AudioRawFrame
2024-05-31 11:36:52 -07:00
Aleix Conchillo Flaqué
77b3e08214
examples: add and update wbesocket eaxmples
2024-05-31 11:36:52 -07:00
Aleix Conchillo Flaqué
42f772beed
examples: some function calling examples cleanup
2024-05-31 11:36:04 -07:00
TomTom101
4b39efeee3
fix(langchain): try/catch langchain import in service; Only langchain is installed with the [langchain] extra ( #190 )
2024-05-31 10:19:27 +02:00
chadbailey59
4c3d19cc8b
Function calling ( #175 )
...
* added function calling code back
* removed old llm_context file
* added integration testing for openai
* added function calling example
* added function callbacks
* added function start callback
* fixup
* fixup
* added different return type support for function calling
* intake example working
* added frame loggers
* cleanup
* fixup
* Update openai.py
* removed function call frame types
* fixup
* re-added example
* renumbered wake phrase
* fixup for autopep8
* remove unused imports
2024-05-30 12:25:39 -05:00
TomTom101
b19243ab75
fix: corrected hint to install Langchain libs
2024-05-30 10:53:42 +02:00
Kwindla Hultman Kramer
920745345a
cartesia tts support
2024-05-29 23:35:35 -07:00
TomTom101
335990c145
wip: hint to install langchain_community
2024-05-30 03:15:14 +02:00
TomTom101
6d24e836b0
wip: Example using LC message history
2024-05-30 03:15:14 +02:00
TomTom101
278a2fed56
wip: First stab at langchain support
...
Is this a service or processor?
How to deal with conversation history? LC has sophisticated means of this, but might get in the way of `LLMResponseAggregator`
2024-05-30 03:15:14 +02:00
Aleix Conchillo Flaqué
6d6d9bea5a
introduce PipelineParams
2024-05-28 17:14:14 -07:00
Kwindla Hultman Kramer
3685c19b2d
moving Deepgram TTS base_url from beta to prod
2024-05-28 15:59:26 -07:00
Aleix Conchillo Flaqué
afea6f38f6
examples: no need to define tts twice
2024-05-24 09:23:00 -07:00
Aleix Conchillo Flaqué
c45d428551
services(google): make api_key argument mandatory
2024-05-24 09:23:00 -07:00
Kwindla Hultman Kramer
681250f114
add new response frame types and vision support for anthropic
2024-05-22 21:12:30 -07:00
Aleix Conchillo Flaqué
acd2d55b84
examples(14): remove commented code
2024-05-22 19:05:18 -07:00
Aleix Conchillo Flaqué
0e5711e62d
examples: update 10-wake-work.py to use WakeCheckFilter
2024-05-22 15:44:44 -07:00
Aleix Conchillo Flaqué
0ddfa3de5b
move WakeCheckFilter to processors/filters
2024-05-22 15:44:43 -07:00
Kwindla Hultman Kramer
2c32cc2f27
improved wake word filter
2024-05-22 15:44:43 -07:00
Aleix Conchillo Flaqué
1c8b9d813a
examples: minot updates to storytelling-chatbot instructions
2024-05-20 10:31:33 -07:00
Kwindla Hultman Kramer
66377954cb
fix up openai vision and gemini implementation
2024-05-19 12:33:57 -07:00
Kwindla Hultman Kramer
b337e984b3
Initial commit of Google Gemini LLM service.
...
Gemini text input works. We translate from OpenAILLMContext format
on the fly in the GoogleLLMService implementation. This commit also
implements image input (vision) in both the GoogleLLMService and in
the OpenAILLMService. Image input is a hack and needs to be revisited.
OpenAI expects images to be uploaded as base64-encoded JPEGs. Google
does not require the base64 encoding. Other than for images, we use
the OpenAI format as our standard, but base64-encoding the images
and then unencoding them in the GoogleLLMService feels wasteful.
2024-05-19 10:35:20 -07:00
Aleix Conchillo Flaqué
c0d5054798
examples: some prompt tweaking
2024-05-19 09:41:36 -07:00
Aleix Conchillo Flaqué
810dc30d3d
examples: fix examples to use LLMFullResponseEndFrame
2024-05-19 09:39:34 -07:00
Aleix Conchillo Flaqué
36dd4933e9
example: add assistant responses to simple chatbot
2024-05-18 10:01:46 -07:00
Aleix Conchillo Flaqué
435fffe1b0
add LLMFullResponseStartFrame/LLMFullResponseEndFrame
2024-05-18 09:49:38 -07:00
Aleix Conchillo Flaqué
2b8f1c4cda
services(openai): send LLMResponseStartFrame for each completion
2024-05-17 17:47:33 -07:00
Aleix Conchillo Flaqué
8dc81042c3
examples: use DailyTranscriptionSettings in translation-chatbot
2024-05-17 15:37:29 -07:00
Aleix Conchillo Flaqué
c77db79447
examples: pipelines readability and add LLM assistants after transport
2024-05-17 14:52:51 -07:00
Aleix Conchillo Flaqué
d66a795413
examples: use SileroVADAnalyzer instead of SileroVAD
2024-05-17 14:18:55 -07:00
Aleix Conchillo Flaqué
a5d246ec0c
vad: use exponential smoothing to avoid sudden changes
2024-05-17 13:53:33 -07:00
Aleix Conchillo Flaqué
f432e2b17e
transports: allow adding a vad analyzer to BaseInputTransport
2024-05-17 13:50:48 -07:00
Aleix Conchillo Flaqué
8c877d7d8e
examples: update 07-interruptible
2024-05-17 13:50:48 -07:00
Aleix Conchillo Flaqué
8965ff27ec
examples: use DEBUG in 09-mirror.py
2024-05-14 19:25:31 -07:00
Aleix Conchillo Flaqué
f6257a86d3
examples: re-enable audio in 09-mirror.py
2024-05-14 19:23:35 -07:00
Aleix Conchillo Flaqué
bd04ea8aca
examples: simplify 09-mirror.py
2024-05-14 19:07:19 -07:00
Aleix Conchillo Flaqué
97f9e9b042
examples: update simple-chatbot prompt
2024-05-14 15:30:31 -07:00
Aleix Conchillo Flaqué
e23addcc02
examples: update simple-chatbot with Spanish
2024-05-14 14:51:44 -07:00
Aleix Conchillo Flaqué
663ff3417c
examples: add missing requirements
2024-05-14 08:03:51 -07:00
Aleix Conchillo Flaqué
2b19d6bbac
examples: remove commented out silero from storytelling
2024-05-14 00:57:21 -07:00
