This folder contains examples organized by topic:
Subfolder | Description |
---|---|
quickstart | The "Hello World" of using Llama 3, start here if you are new to using Llama 3 |
multilingual | Scripts to add a new language to Llama |
finetuning | Scripts to finetune Llama 3 on single-GPU and multi-GPU setups |
inference | Scripts to deploy Llama 3 for inference locally, on mobile Android and using model servers |
use_cases | Scripts showing common applications of Llama 3 |
responsible_ai | Scripts to use PurpleLlama for safeguarding model outputs |
llama_api_providers | Scripts to run inference on Llama via hosted endpoints |
benchmarks | Scripts to benchmark Llama 3 models inference on various backends |
code_llama | Scripts to run inference with the Code Llama models |
evaluation | Scripts to evaluate fine-tuned Llama 3 models using lm-evaluation-harness from EleutherAI |