9e5e4a9970
Bound transcript memory and translation queue size
...
- Add MAX_TRANSCRIPT_LENGTH (500) and MAX_TRANSLATION_QUEUE_SIZE (100)
class constants to ServeClientBase
- Trim transcript and text lists after each update_segments() call
- Create translation queue with maxsize to prevent unbounded growth
- Added tests for _trim_transcript()
2026-04-17 09:29:38 -04:00
e8bd4fd532
Add cross-client GPU batch inference for faster_whisper backend
2026-02-26 00:00:51 +00:00
c43eb1dd5a
update to support faster whisper 1.2.0
2025-10-07 14:20:20 +00:00
2b8b245fa8
Add translation backend
...
Translate from any language to any language with alirezamsh/small100
running in a thread and reading from a queue shared with transcription thread.
Signed-off-by: makaveli10 <vineet.suryan@collabora.com >
2025-07-22 08:54:10 +00:00
74abf66d48
Make cache path configurable to save auto converted ct2 models
...
Signed-off-by: makaveli10 <vineet.suryan@collabora.com >
2025-06-01 09:04:22 +00:00
bff88ed3e7
Auto convert hf custom whisper to ct2(faster-whisper)
...
Signed-off-by: makaveli10 <vineet.suryan@collabora.com >
2025-05-29 09:23:32 +00:00
275ed4e45b
Merge branch 'main' into configure-more-params
2025-05-02 12:23:45 +02:00
0abf8693ef
refactor: include additional parameters
...
Refactor ServeClientBase and its subclasses to include additional parameters for segment handling and audio clipping.
2025-04-25 13:09:44 +02:00
47ee035f65
Upgrade tensorrt_llm to v0.18.2
...
Signed-off-by: makaveli10 <vineet.suryan@collabora.com >
2025-04-22 12:33:03 +00:00
9b364f267a
Remove blank segment feature
...
Signed-off-by: makaveli10 <vineet.suryan@collabora.com >
2025-04-17 08:29:14 +00:00
fb3deb2745
Remove clip_audio from faster_whisper backend
...
Signed-off-by: makaveli10 <vineet.suryan@collabora.com >
2025-04-15 08:00:46 +00:00
a62495b090
Integrate OpenVINO backend
...
Signed-off-by: makaveli <vineet.suryan@collabora.com >
2025-03-31 12:57:19 +05:30
c1ac71ada0
Refactor 🔨
...
Signed-off-by: makaveli10 <vineet.suryan@collabora.com >
2025-03-24 16:48:33 +05:30
Aaron Boxer