cjones/WhisperLive
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #35 from makaveli10/dockerfile_cpu

Browse Source 
Update readme dockerfile cpu/gpu.
This commit is contained in:
Marcus Edel
2023-08-08 08:03:09 -04:00
committed by GitHub
parent 36e1f03f37 e1d77e4205
commit 3cd1cc6a63
1 changed files with 9 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+9 -6
View File
@@ -58,16 +58,19 @@ This would start the websocket server on port ```9090```.
- Refer to [Audio-Transcription-Firefox](https://github.com/collabora/whisper-live/tree/main/Audio-Transcription-Firefox#readme) to use Mozilla Firefox extension. - Refer to [Audio-Transcription-Firefox](https://github.com/collabora/whisper-live/tree/main/Audio-Transcription-Firefox#readme) to use Mozilla Firefox extension.
## Whisper Live Server in Docker ## Whisper Live Server in Docker
- Build docker container - GPU
```bash
docker build . -t whisper-live
```
- Run docker container
```bash ```bash
docker build . -t whisper-live -f docker/Dockerfile.gpu
docker run -it --gpus all -p 9090:9090 whisper-live:latest docker run -it --gpus all -p 9090:9090 whisper-live:latest
``` ```
- CPU
```bash
docker build . -t whisper-live -f docker/Dockerfile.cpu
docker run -it -p 9090:9090 whisper-live:latest
```
**Note**: By default we use "small" model size. To build docker image for a different model size, change the size in server.py and then build the docker image.
## Future Work ## Future Work
- [ ] Add translation to other languages on top of transcription. - [ ] Add translation to other languages on top of transcription.
- [ ] TensorRT backend for Whisper. - [ ] TensorRT backend for Whisper.