Chester Hu 816b25fc8f Remove local tokenizer requirement for vllm on prem throughput benchmark 11 月之前
..
benchmarks 816b25fc8f Remove local tokenizer requirement for vllm on prem throughput benchmark 11 月之前
code_llama 6d449a859b New folder structure (#1) 1 年之前
evaluation a2a2ffd78a fix lm_eval.tasks' has no attribute 'initialize_tasks' error 11 月之前
finetuning 9da9f01cdc fixes 11 月之前
inference 9da9f01cdc fixes 11 月之前
llama_api_providers 3d2c739aee Update azure_api_example.ipynb 11 月之前
multilingual e98f6de80d typo 1 年之前
quickstart 23afbd481e some typo fixes; codellama 70; tokens generated; colab link 1 年之前
responsible_ai c1be7d802a Updating responsible AI main readme 1 年之前
use_cases ccab291ce5 [OctoAI] Introducing a Video Generation use case featuring Llama3 (#496) 11 月之前
README.md 6892ea1ac9 update readme and delete stale content 11 月之前

README.md

This folder contains examples organized by topic:

Subfolder Description
quickstart The "Hello World" of using Llama 3, start here if you are new to using Llama 3
multilingual Scripts to add a new language to Llama
finetuning Scripts to finetune Llama 3 on single-GPU and multi-GPU setups
inference Scripts to deploy Llama 3 for inference locally and using model servers
use_cases Scripts showing common applications of Llama 3
responsible_ai Scripts to use PurpleLlama for safeguarding model outputs
llama_api_providers Scripts to run inference on Llama via hosted endpoints
benchmarks Scripts to benchmark Llama 3 models inference on various backends
code_llama Scripts to run inference with the Code Llama models
evaluation Scripts to evaluate fine-tuned Llama 3 models using lm-evaluation-harness from EleutherAI