Pārlūkot izejas kodu

Create README.md

Add benchmarks top-level README
Chester Hu 10 mēneši atpakaļ
vecāks
revīzija
fa02ded685
1 mainītis faili ar 4 papildinājumiem un 0 dzēšanām
  1. 4 0
      tools/benchmarks/README.md

+ 4 - 0
tools/benchmarks/README.md

@@ -0,0 +1,4 @@
+# Benchmarks
+
+* inference - a folder contains benchmark scripts that apply a throughput analysis for Llama models inference on various backends including on-prem, cloud and on-device.
+* llm_eval_harness - a folder contains a tool to evaluate fine-tuned Llama models including quantized models focusing on quality.