Home Verkennen Help
Inloggen
radu
/
LLamaRecipes
spiegel van https://github.com/facebookresearch/llama-recipes.git
Volgen 1
Ster 0
Vork 0
Bestanden Kwesties 0 Wiki
Boom: v0.0.2
Aftakkingen Labels
LLamaRecipes
/
recipes
/
inference
/
model_servers
Navyata Bawa 93cd3b99d2 Updating links to running llama3 locally 11 maanden geleden
..
hf_text_generation_inference 6d449a859b New folder structure (#1) 1 jaar geleden
vllm 6d449a859b New folder structure (#1) 1 jaar geleden
README.md 6892ea1ac9 update readme and delete stale content 11 maanden geleden
llama-on-prem.md 93cd3b99d2 Updating links to running llama3 locally 11 maanden geleden

README.md

Running Llama 3 On-Prem with vLLM and TGI

This tutorial shows how to use Llama 3 with vLLM and Hugging Face TGI to build Llama 3 on-prem apps.