| quickstart |
The "Hello World" of using Llama 3, start here if you are new to using Llama 3 |
| multilingual |
Scripts to add a new language to Llama |
| finetuning |
Scripts to finetune Llama 3 on single-GPU and multi-GPU setups |
| inference |
Scripts to deploy Llama 3 for inference locally and using model servers |
| use_cases |
Scripts showing common applications of Llama 3 |
| responsible_ai |
Scripts to use PurpleLlama for safeguarding model outputs |
| llama_api_providers |
Scripts to run inference on Llama via hosted endpoints |
| benchmarks |
Scripts to benchmark Llama 3 models inference on various backends |
| code_llama |
Scripts to run inference with the Code Llama models |
| evaluation |
Scripts to evaluate fine-tuned Llama 3 models using lm-evaluation-harness from EleutherAI |
Chester Hu
816b25fc8f
Remove local tokenizer requirement for vllm on prem throughput benchmark