소스 검색

fix typo and readme

Kai Wu 8 달 전
부모
커밋
2f0a006b68
3개의 변경된 파일10개의 추가작업 그리고 4개의 파일을 삭제
  1. 6 0
      .github/scripts/spellcheck_conf/wordlist.txt
  2. 1 1
      tools/benchmarks/README.md
  3. 3 3
      tools/benchmarks/llm_eval_harness/README.md

+ 6 - 0
.github/scripts/spellcheck_conf/wordlist.txt

@@ -1451,3 +1451,9 @@ openhathi
 sarvam
 subtask
 acc
+BigBench
+IFEval
+MuSR
+Multistep
+multistep
+algorithmically

+ 1 - 1
tools/benchmarks/README.md

@@ -1,4 +1,4 @@
 # Benchmarks
 
 * inference - a folder contains benchmark scripts that apply a throughput analysis for Llama models inference on various backends including on-prem, cloud and on-device.
-* llm_eval_harness - a folder contains a tool to evaluate fine-tuned Llama models including quantized models focusing on quality.  
+* llm_eval_harness - a folder that introduces `lm-evaluation-harness`, a tool to evaluate Llama models including quantized models focusing on quality. We also included a recipe that reproduces Meta 3.1 evaluation metrics Using `lm-evaluation-harness` and instructions that reproduce HuggingFace Open LLM Leaderboard v2 metrics.

파일 크기가 너무 크기때문에 변경 상태를 표시하지 않습니다.
+ 3 - 3
tools/benchmarks/llm_eval_harness/README.md