| .. |
|
chat_vllm_benchmark.py
|
816b25fc8f
Remove local tokenizer requirement for vllm on prem throughput benchmark
|
%!s(int64=2) %!d(string=hai) anos |
|
input.jsonl
|
367e4869ac
Reorg inference throughput folder structure
|
%!s(int64=2) %!d(string=hai) anos |
|
parameters.json
|
816b25fc8f
Remove local tokenizer requirement for vllm on prem throughput benchmark
|
%!s(int64=2) %!d(string=hai) anos |
|
pretrained_vllm_benchmark.py
|
816b25fc8f
Remove local tokenizer requirement for vllm on prem throughput benchmark
|
%!s(int64=2) %!d(string=hai) anos |