update readme dockerfile cpu/gpu

This commit is contained in:
makaveli10
2023-08-08 14:18:15 +08:00
parent 6927a44b5b
commit e1d77e4205
+9 -6
View File
@@ -58,16 +58,19 @@ This would start the websocket server on port ```9090```.
- Refer to [Audio-Transcription-Firefox](https://github.com/collabora/whisper-live/tree/main/Audio-Transcription-Firefox#readme) to use Mozilla Firefox extension. - Refer to [Audio-Transcription-Firefox](https://github.com/collabora/whisper-live/tree/main/Audio-Transcription-Firefox#readme) to use Mozilla Firefox extension.
## Whisper Live Server in Docker ## Whisper Live Server in Docker
- Build docker container - GPU
```bash
docker build . -t whisper-live
```
- Run docker container
```bash ```bash
docker build . -t whisper-live -f docker/Dockerfile.gpu
docker run -it --gpus all -p 9090:9090 whisper-live:latest docker run -it --gpus all -p 9090:9090 whisper-live:latest
``` ```
- CPU
```bash
docker build . -t whisper-live -f docker/Dockerfile.cpu
docker run -it -p 9090:9090 whisper-live:latest
```
**Note**: By default we use "small" model size. To build docker image for a different model size, change the size in server.py and then build the docker image.
## Future Work ## Future Work
- [ ] Add translation to other languages on top of transcription. - [ ] Add translation to other languages on top of transcription.
- [ ] TensorRT backend for Whisper. - [ ] TensorRT backend for Whisper.