 Lincoln Wallace
|
95a9b7ef05
|
fix(run_server.py): help text for max_connection_time argument
The help text for `--max_connection_time` is incorrect. Looks like a copy-paste mistake from `--cache_path`.
|
2025-09-25 11:14:35 -03:00 |
|
|
makaveli10
|
8d6ddd4f7b
|
Change max_clients max_connection_time from server only
Signed-off-by: makaveli10 <vineet.suryan@collabora.com>
|
2025-07-21 22:52:24 +05:30 |
|
|
makaveli10
|
74abf66d48
|
Make cache path configurable to save auto converted ct2 models
Signed-off-by: makaveli10 <vineet.suryan@collabora.com>
|
2025-06-01 09:04:22 +00:00 |
|
|
makaveli10
|
47ee035f65
|
Upgrade tensorrt_llm to v0.18.2
Signed-off-by: makaveli10 <vineet.suryan@collabora.com>
|
2025-04-22 12:33:03 +00:00 |
|
|
makaveli
|
a62495b090
|
Integrate OpenVINO backend
Signed-off-by: makaveli <vineet.suryan@collabora.com>
|
2025-03-31 12:57:19 +05:30 |
|
|
Andreas Peldszus
|
14077315ae
|
Fix argparser option
|
2024-06-05 10:34:22 +02:00 |
|
|
Andreas Peldszus
|
ab17c4dbc6
|
Make single model mode the default, update readme
|
2024-06-05 09:47:52 +02:00 |
|
|
Andreas Peldszus
|
3c09289dea
|
Add single model mode for custom models
- Use a threadlock around the model in single model mode
|
2024-05-31 15:06:47 +02:00 |
|
|
makaveli10
|
819ab35b28
|
fix: limit CPU usage for VAD onnxruntime inference session by setting OMP_NUM_THREADS
Signed-off-by: makaveli10 <vineet.suryan@collabora.com>
|
2024-05-24 04:58:49 -04:00 |
|
|
makaveli10
|
9fbff47126
|
🔨 refactor whisper_live according to flake8
|
2024-02-09 13:45:13 +05:30 |
|
|
makaveli10
|
735d6c7763
|
merge with main
|
2024-01-19 11:43:21 +00:00 |
|
|
makaveli10
|
647c576e6a
|
update with multilingual option
|
2024-01-11 08:17:56 +00:00 |
|
|
makaveli10
|
244ca9e6ba
|
remove duplicate code
|
2024-01-10 14:14:48 +00:00 |
|
|
makaveli10
|
0f9e93d203
|
add: tensorrt backend to server
|
2024-01-09 18:10:17 +00:00 |
|
|
makaveli10
|
9e60160f87
|
remove unused improt
|
2023-08-09 04:06:11 +08:00 |
|
|
makaveli10
|
1a4775bac2
|
add client queue
|
2023-08-07 22:07:51 +08:00 |
|
|
Marcus Edel
|
8db533dd6b
|
Use the updated run method to start the server.
|
2023-08-03 09:54:14 -04:00 |
|
|
makaveli10
|
f6f5b6ba8a
|
run_server to start server in docker
|
2023-08-02 16:16:48 +08:00 |
|