README.md 1.1 KB

This folder contains examples organized by topic:

Subfolder Description
quickstart The "Hello World" of using Llama 3, start here if you are new to using Llama 3
multilingual Scripts to add a new language to Llama
finetuning Scripts to finetune Llama 3 on single-GPU and multi-GPU setups
inference Scripts to deploy Llama 3 for inference locally, on mobile Android and using model servers
use_cases Scripts showing common applications of Llama 3
responsible_ai Scripts to use PurpleLlama for safeguarding model outputs
llama_api_providers Scripts to run inference on Llama via hosted endpoints
benchmarks Scripts to benchmark Llama 3 models inference on various backends
code_llama Scripts to run inference with the Code Llama models
evaluation Scripts to evaluate fine-tuned Llama 3 models using lm-evaluation-harness from EleutherAI