Startseite Erkunden Hilfe
Anmelden
radu
/
LLamaRecipes
Mirror von https://github.com/facebookresearch/llama-recipes.git
Beobachten 1
Favorit hinzufügen 0
Fork 0
Dateien Issues 0 Wiki
Struktur: 48ea26cba3
Branches Tags
LLamaRecipes
/
tools
/
benchmarks
Kai Wu ff10442db1 add result table to README vor 1 Jahr
..
inference 4be3eb0d17 Updates HF model_ids and readmes for 3.1 vor 1 Jahr
llm_eval_harness 4be3eb0d17 Updates HF model_ids and readmes for 3.1 vor 1 Jahr
meta_eval_reproduce ff10442db1 add result table to README vor 1 Jahr
README.md fa02ded685 Create README.md vor 1 Jahr

README.md

Benchmarks

  • inference - a folder contains benchmark scripts that apply a throughput analysis for Llama models inference on various backends including on-prem, cloud and on-device.
  • llm_eval_harness - a folder contains a tool to evaluate fine-tuned Llama models including quantized models focusing on quality.