wx44wx/pipecat
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Fly.io example: remove step to cache silero models.

Browse Source 
No longer necessary.
This commit is contained in:
Lewis Wolfgang
2024-08-05 10:12:35 -04:00
parent b20bacb9ed
commit 9f07c3ca27
3 changed files with 1 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/deployment/flyio-example/Dockerfile
View File

@@ -9,8 +9,5 @@ COPY *.py .
COPY ./requirements.txt requirements.txt COPY ./requirements.txt requirements.txt
RUN pip3 install --no-cache-dir --upgrade -r requirements.txt RUN pip3 install --no-cache-dir --upgrade -r requirements.txt
# Install models
RUN python3 install_deps.py
# Start the FastAPI server # Start the FastAPI server
CMD python3 bot_runner.py --port ${FAST_API_PORT} CMD python3 bot_runner.py --port ${FAST_API_PORT}

6
examples/deployment/flyio-example/README.md
View File

@@ -2,8 +2,6 @@
This project modifies the `bot_runner.py` server to launch a new machine for each user session. This is a recommended approach for production vs. running shell processess as your deployment will quickly run out of system resources under load. This project modifies the `bot_runner.py` server to launch a new machine for each user session. This is a recommended approach for production vs. running shell processess as your deployment will quickly run out of system resources under load.
To speed up machine boot times, we also download and cache Silero VAD as part of the Dockerfile (`install_deps.py`). If you are using other custom models, you can add them here too.
For this example, we are using Daily as a WebRTC transport and provisioning a new room and token for each session. You can use another transport, such as WebSockets, by modifying the `bot.py` and `bot_runner.py` files accordingly. For this example, we are using Daily as a WebRTC transport and provisioning a new room and token for each session. You can use another transport, such as WebSockets, by modifying the `bot.py` and `bot_runner.py` files accordingly.
## Setting up your fly.io deployment ## Setting up your fly.io deployment
@@ -14,7 +12,7 @@ You can copy the `example-fly.toml` as a reference. Be sure to change the app na
### Create your .env file ### Create your .env file
Copy the base `env.example` to `.env` and enter the necessary API keys. Copy the base `env.example` to `.env` and enter the necessary API keys.
`FLY_APP_NAME` should match that in the `fly.toml` file. `FLY_APP_NAME` should match that in the `fly.toml` file.
@@ -32,7 +30,6 @@ Note: you can do this manually via the fly.io dashboard under the "secrets" sub-
`fly deploy` `fly deploy`
## Connecting to your bot ## Connecting to your bot
Send a post request to your running fly.io instance: Send a post request to your running fly.io instance:
@@ -40,4 +37,3 @@ Send a post request to your running fly.io instance:
`curl --location --request POST 'https://YOUR_FLY_APP_NAME/start_bot'` `curl --location --request POST 'https://YOUR_FLY_APP_NAME/start_bot'`
This request will wait until the machine enters into a `starting` state, before returning the a room URL and token to join. This request will wait until the machine enters into a `starting` state, before returning the a room URL and token to join.

4
examples/deployment/flyio-example/install_deps.py
View File

@@ -1,4 +0,0 @@
import torch
# Download (cache) the Silero VAD model
torch.hub.load(repo_or_dir='snakers4/silero-vad', model='silero_vad', force_reload=True)