Author | SHA1 Message | Date |
---|---|---|
|
816b25fc8f Remove local tokenizer requirement for vllm on prem throughput benchmark | 1 year ago |
|
dac9594757 changed readme.md and parameters.json to support llama3 vllm benchmark | 1 year ago |
|
367e4869ac Reorg inference throughput folder structure | 1 year ago |