Pia Papanna 4344a420f2 recipes/quickstart folder updated 1 سال پیش
..
hf_text_generation_inference 4344a420f2 recipes/quickstart folder updated 1 سال پیش
lamini 66c89495da update recipes with lamini recipe 1 سال پیش
vllm 4344a420f2 recipes/quickstart folder updated 1 سال پیش
README.md 4344a420f2 recipes/quickstart folder updated 1 سال پیش
llama-on-prem.md 4344a420f2 recipes/quickstart folder updated 1 سال پیش

README.md

Running Llama 3 On-Prem with vLLM and TGI

This tutorial shows how to use Llama 3 with vLLM and Hugging Face TGI to build Llama 3 on-prem apps.