Commit Graph

348 Commits

Author SHA1 Message Date
Marcus Edel e64bc9f3d6 Merge pull request #116 from makaveli10/tensorrt_model_warmup
Tensorrt model warmup.
2024-01-31 11:49:40 -05:00
Sasa Trivic 7cc945aded self.client_uid accessed without being defined 2024-01-31 16:45:31 +01:00
makaveli 2c8a25d355 Merge pull request #119 from gchust/main
fix: keyError: 'model' in server, when using browser extension
2024-01-31 18:40:27 +05:30
makaveli10 f4027de343 add: save_transcript to srt file 2024-01-31 17:37:30 +05:30
makaveli10 d1754d2c46 fix: model_size, no_speech, segment timings 2024-01-31 17:37:03 +05:30
gchust 0e6b1c0632 fix: keyError: 'model' in server, when using browser extension 2024-01-31 11:33:48 +00:00
makaveli d6b51ccd7d Update TensorRT_whisper.md
typo: setup.sh file path
2024-01-29 12:33:12 +05:30
makaveli 2f3c1cd172 Update TensorRT_whisper.md
fix: typo in bash script name to build tensorrt engine
2024-01-29 12:27:51 +05:30
makaveli 703263b375 wamrup tensorrt engine 2024-01-29 12:17:27 +05:30
makaveli 30d2cffb93 load audio for warmup 2024-01-29 12:15:39 +05:30
makaveli 4d94c6b38b Update server.txt
install ffmpeg-python to load test file for model warmup
2024-01-29 12:10:18 +05:30
makaveli d5a0f5859e Update TensorRT_whisper.md
ffmpeg is needed for model warmup
2024-01-29 12:06:56 +05:30
makaveli 025873d2ca Update TensorRT server requirements 2024-01-29 11:57:03 +05:30
makaveli 8c36768f7f Merge pull request #112 from lightwastak3n/main
Readme: Fix transcribe examples
2024-01-26 00:27:43 +05:30
Sasa Trivic ce13e7b622 Fix transcribe examples 2024-01-25 18:44:23 +01:00
makaveli 3498787ccd Merge pull request #104 from makaveli10/tensorrt_backend
Tensorrt backend
2024-01-24 16:42:18 +05:30
makaveli 5cd59b1e4c Update README.md
Co-authored-by: Marcus Edel <marcus.edel@fu-berlin.de>
2024-01-24 10:09:22 +05:30
makaveli10 bd543295f3 update readme 2024-01-22 11:54:21 +00:00
makaveli10 8e2642283a update tensorrt readme 2024-01-22 11:48:23 +00:00
makaveli10 3bf5b47947 fix: server; remove debug stats 2024-01-22 11:47:01 +00:00
makaveli10 634dae835b add numba to req(trt-llm) 2024-01-22 11:45:11 +00:00
makaveli10 969a5aa9e5 remove trt_llm install script 2024-01-22 11:44:48 +00:00
makaveli10 44a2e20c68 remove trt-llm dockerfile 2024-01-22 11:44:21 +00:00
makaveli10 986823dbef Merge remote-tracking branch 'upstream/main' into tensorrt_backend 2024-01-19 10:45:01 -05:00
makaveli10 1e2faa3f2b fix: tensorrt llm idocker setup & docs 2024-01-19 10:40:59 -05:00
makaveli10 e3084b34cb update tensorrt docker & readme 2024-01-19 07:30:50 -05:00
makaveli10 b955e63dc1 update READM 2024-01-19 12:02:18 +00:00
makaveli10 f25ff1785a increase chunk size from 64ms to 256ms 2024-01-19 12:02:05 +00:00
makaveli10 867ff522ae add tensorrt installation & whisper conversion script 2024-01-19 11:59:16 +00:00
makaveli10 75001ae6b7 updatetensorrt-llm dockerfile 2024-01-19 11:58:40 +00:00
makaveli10 6f1d13f25b update requirements 2024-01-19 11:57:46 +00:00
makaveli10 7a9dc6db40 add tensorrt readme 2024-01-19 11:53:47 +00:00
makaveli10 735d6c7763 merge with main 2024-01-19 11:43:21 +00:00
Marcus Edel 0942dc2cfd Merge pull request #102 from makaveli10/change_model_size_param_name
Server to control custom model usage.
2024-01-18 11:07:18 -05:00
makaveli10 881fd55776 run server with custom model from args 2024-01-18 15:02:51 +08:00
makaveli 0c01d7b1e5 Merge pull request #98 from makaveli10/change_model_size_param_name
Change model size param name
2024-01-15 21:08:26 +05:30
makaveli10 c810369324 revert the default port of chrom/firefox extension to 9090 2024-01-15 23:30:05 +08:00
makaveli10 71d0fe69c6 add option to use custom model 2024-01-15 23:28:02 +08:00
makaveli10 67232fffd5 install whl 2024-01-12 11:39:05 +00:00
makaveli10 076aebf3b6 bump version v0.0.11 v0.0.11 2024-01-12 15:21:27 +05:30
makaveli10 4cf9d95f73 merge main 2024-01-12 08:17:46 +00:00
makaveli10 389bb5ae37 add docker setup for tensorrt-llm; update readme 2024-01-12 08:15:53 +00:00
Marcus Edel a7eedc5d84 Merge pull request #94 from makaveli10/fix_error_messages
Fix: error messages.
2024-01-11 09:52:07 -05:00
makaveli d91330d790 Merge branch 'collabora:main' into fix_error_messages 2024-01-11 18:18:58 +05:30
makaveli 783d147316 Merge pull request #96 from makaveli10/fix_key_error
fix: key error
2024-01-11 16:29:07 +05:30
makaveli10 058c93e55e fix: key error 2024-01-11 18:55:43 +08:00
makaveli10 f06b9bc827 remove torch req 2024-01-11 08:18:51 +00:00
makaveli10 3c202bf836 update README; add TensorRT doc 2024-01-11 08:18:25 +00:00
makaveli10 647c576e6a update with multilingual option 2024-01-11 08:17:56 +00:00
makaveli10 71a062b726 update dockerfiles 2024-01-10 14:30:57 +00:00