Chester Hu 816b25fc8f Remove local tokenizer requirement for vllm on prem throughput benchmark 11 months ago
..
benchmarks 816b25fc8f Remove local tokenizer requirement for vllm on prem throughput benchmark 11 months ago
code_llama 6d449a859b New folder structure (#1) 1 year ago
evaluation a2a2ffd78a fix lm_eval.tasks' has no attribute 'initialize_tasks' error 11 months ago
finetuning 9da9f01cdc fixes 11 months ago
inference 9da9f01cdc fixes 11 months ago
llama_api_providers 3d2c739aee Update azure_api_example.ipynb 11 months ago
multilingual e98f6de80d typo 1 year ago
quickstart 23afbd481e some typo fixes; codellama 70; tokens generated; colab link 11 months ago
responsible_ai c1be7d802a Updating responsible AI main readme 1 year ago
use_cases ccab291ce5 [OctoAI] Introducing a Video Generation use case featuring Llama3 (#496) 11 months ago
README.md 6892ea1ac9 update readme and delete stale content 11 months ago

README.md

This folder contains examples organized by topic:

Subfolder Description
quickstart The "Hello World" of using Llama 3, start here if you are new to using Llama 3
multilingual Scripts to add a new language to Llama
finetuning Scripts to finetune Llama 3 on single-GPU and multi-GPU setups
inference Scripts to deploy Llama 3 for inference locally and using model servers
use_cases Scripts showing common applications of Llama 3
responsible_ai Scripts to use PurpleLlama for safeguarding model outputs
llama_api_providers Scripts to run inference on Llama via hosted endpoints
benchmarks Scripts to benchmark Llama 3 models inference on various backends
code_llama Scripts to run inference with the Code Llama models
evaluation Scripts to evaluate fine-tuned Llama 3 models using lm-evaluation-harness from EleutherAI