Suraj
4be3eb0d17
Updates HF model_ids and readmes for 3.1
|
7 달 전 | |
|---|---|---|
| .. | ||
| inference | 7 달 전 | |
| llm_eval_harness | 7 달 전 | |
| README.md | 8 달 전 | |
README.md
Benchmarks
- inference - a folder contains benchmark scripts that apply a throughput analysis for Llama models inference on various backends including on-prem, cloud and on-device.
- llm_eval_harness - a folder contains a tool to evaluate fine-tuned Llama models including quantized models focusing on quality.