radu/LLamaRecipes @ Remove-Tokenizer-onPrem-vllm-InferenceThroughput

огледало од https://github.com/facebookresearch/llama-recipes.git

Jeff Tang 6892ea1ac9 update readme and delete stale content		пре 11 месеци
..
hf_text_generation_inference	6d449a859b New folder structure (#1)	пре 1 година
vllm	6d449a859b New folder structure (#1)	пре 1 година
README.md	6892ea1ac9 update readme and delete stale content	пре 11 месеци
llama-on-prem.md	5cedef2155 Update llama-on-prem.md	пре 1 година

Running Llama 3 On-Prem with vLLM and TGI

This tutorial shows how to use Llama 3 with vLLM and Hugging Face TGI to build Llama 3 on-prem apps.