Inicio Explorar Axuda
Iniciar sesión
radu
/
LLamaRecipes
réplica de https://github.com/facebookresearch/llama-recipes.git
Seguir 1
Destacar 0
Fork 0
Ficheiros Incidencias 0 Wiki
Árbore: 4d0448631d
Ramas Etiquetas
LLamaRecipes
/
tools
/
benchmarks
Pia Papanna 4487513793 Updating the folder name 3p_integrations hai 1 ano
..
inference 4487513793 Updating the folder name 3p_integrations hai 1 ano
llm_eval_harness 6ff1184120 Updated tools folder under llama-recipes %!s(int64=2) %!d(string=hai) anos
README.md fa02ded685 Create README.md %!s(int64=2) %!d(string=hai) anos

README.md

Benchmarks

  • inference - a folder contains benchmark scripts that apply a throughput analysis for Llama models inference on various backends including on-prem, cloud and on-device.
  • llm_eval_harness - a folder contains a tool to evaluate fine-tuned Llama models including quantized models focusing on quality.