Kai Wu dac9594757 changed readme.md and parameters.json to support llama3 vllm benchmark 1 year ago
..
chat_vllm_benchmark.py 367e4869ac Reorg inference throughput folder structure 1 year ago
input.jsonl 367e4869ac Reorg inference throughput folder structure 1 year ago
parameters.json dac9594757 changed readme.md and parameters.json to support llama3 vllm benchmark 1 year ago
pretrained_vllm_benchmark.py 367e4869ac Reorg inference throughput folder structure 1 year ago