Suraj Subramanian
bbc55b4069
Merge remote-tracking branch 'upstream/main' into chester-benchmarks
|
před 1 rokem | |
|---|---|---|
| .. | ||
| inference | před 1 rokem | |
| llm_eval_harness | před 1 rokem | |
| README.md | před 1 rokem | |
README.md
Benchmarks
- inference - a folder contains benchmark scripts that apply a throughput analysis for Llama models inference on various backends including on-prem, cloud and on-device.
- llm_eval_harness - a folder contains a tool to evaluate fine-tuned Llama models including quantized models focusing on quality.