Pia Papanna 8dc0578702 Fixing broken file paths vor 1 Jahr
..
hf_text_generation_inference 8dc0578702 Fixing broken file paths vor 1 Jahr
lamini 8dc0578702 Fixing broken file paths vor 1 Jahr
vllm 8dc0578702 Fixing broken file paths vor 1 Jahr
README.md 8dc0578702 Fixing broken file paths vor 1 Jahr
llama-on-prem.md 8dc0578702 Fixing broken file paths vor 1 Jahr

README.md

Running Llama 3 On-Prem with vLLM and TGI

This tutorial shows how to use Llama 3 with vLLM and Hugging Face TGI to build Llama 3 on-prem apps.