45 lines
1.1 KiB
Markdown
45 lines
1.1 KiB
Markdown
# Moondream Chatbot
|
||
|
||
<img src="image.png" width="420px">
|
||
|
||
|
||
This app connects you to a chatbot powered by GPT-4, complete with animations generated by Stable Video Diffusion. The chatbot also has vision powers thanks to [Moondream](https://moondream.ai) so you can ask it, for example, "what do you see?".
|
||
|
||
ℹ️ The first time, things might take some time to get started since VAD (Voice Activity Detection) and vision models need to be downloaded.
|
||
|
||
## Get started
|
||
|
||
```python
|
||
python3 -m venv venv
|
||
source venv/bin/activate
|
||
pip install -r requirements.txt
|
||
|
||
cp env.example .env # and add your credentials
|
||
|
||
```
|
||
|
||
## Run the server
|
||
|
||
```bash
|
||
python server.py
|
||
```
|
||
|
||
Then, visit `http://localhost:7860/start` in your browser to start a chatbot
|
||
session.
|
||
|
||
## Build and test the Docker image
|
||
|
||
```
|
||
docker build -t moonbot .
|
||
docker run --env-file .env -p 7860:7860 moonbot
|
||
```
|
||
|
||
### For Intel GPUs (Arc, Max and Flex series)
|
||
|
||
```
|
||
docker build -t moonbot -f Dockerfile.intel .
|
||
docker run --env-file .env -p 7860:7860 --device /dev/dri moonbot
|
||
```
|
||
|
||
You can try to visit `http://localhost:7860/start` again.
|