 makaveli10
|
aaa47cfab5
|
Fix requirements & upgrade tensorrt-llm
Signed-off-by: makaveli10 <vineet.suryan@collabora.com>
|
2024-09-16 00:25:23 -04:00 |
|
|
makaveli10
|
e4579ef291
|
Dockerfile tensorrt use cuda-runtimee as base image to reduce size
Signed-off-by: makaveli10 <vineet.suryan@collabora.com>
|
2024-06-03 06:44:09 -04:00 |
|
|
makaveli10
|
f73a146eb9
|
Update TensorRT backend tensorrt_llm==0.9.0
Signed-off-by: makaveli10 <vineet.suryan@collabora.com>
|
2024-06-03 05:24:41 -04:00 |
|
|
Andreas Peldszus
|
dccfce2a3c
|
Improve cpu and gpu Dockerfiles, resulting in much smaller images
|
2024-04-26 15:51:11 +02:00 |
|
|
makaveli10
|
8a06ba802b
|
update cuda version 12.2.2 gpu dockerfile
|
2024-03-04 03:24:49 -05:00 |
|
|
makaveli10
|
ea64d47899
|
run server with python3
|
2024-02-26 18:50:18 +05:30 |
|
|
makaveli10
|
d1de4948ee
|
update base cuda version to 11.8; some dockerfile-gpu fixes
|
2024-02-19 04:38:41 -05:00 |
|
|
makaveli10
|
6cabbe441b
|
update cpu dockerfile with python-slim-buster base image
|
2024-02-16 18:58:38 +05:30 |
|
|
makaveli10
|
44a2e20c68
|
remove trt-llm dockerfile
|
2024-01-22 11:44:21 +00:00 |
|
|
makaveli10
|
1e2faa3f2b
|
fix: tensorrt llm idocker setup & docs
|
2024-01-19 10:40:59 -05:00 |
|
|
makaveli10
|
e3084b34cb
|
update tensorrt docker & readme
|
2024-01-19 07:30:50 -05:00 |
|
|
makaveli10
|
75001ae6b7
|
updatetensorrt-llm dockerfile
|
2024-01-19 11:58:40 +00:00 |
|
|
makaveli10
|
389bb5ae37
|
add docker setup for tensorrt-llm; update readme
|
2024-01-12 08:15:53 +00:00 |
|
|
makaveli10
|
71a062b726
|
update dockerfiles
|
2024-01-10 14:30:57 +00:00 |
|
|
makaveli10
|
e602ba1282
|
add cpu&gpu specifice Dockerfiles
|
2023-08-07 23:12:53 +08:00 |
|