Página inicial Explorar Ajuda
Entrar
radu
/
LLamaRecipes
mirror de https://github.com/facebookresearch/llama-recipes.git
Observar 1
Favorito 0
Fork 0
Arquivos Issues 0 Wiki
Tree: 5be3d4a152
Branches Tags
LLamaRecipes
/
recipes
/
3p_integration
Suraj Subramanian bbc55b4069 Merge remote-tracking branch 'upstream/main' into chester-benchmarks 1 ano atrás
..
aws f9ba09166c 3p_integration folder updates 1 ano atrás
azure bbc55b4069 Merge remote-tracking branch 'upstream/main' into chester-benchmarks 1 ano atrás
groq f9ba09166c 3p_integration folder updates 1 ano atrás
lamini f9ba09166c 3p_integration folder updates 1 ano atrás
octoai f9ba09166c 3p_integration folder updates 1 ano atrás
tgi f9ba09166c 3p_integration folder updates 1 ano atrás
vllm 8dc0578702 Fixing broken file paths 1 ano atrás
README.md f9ba09166c 3p_integration folder updates 1 ano atrás
llama_on_prem.md f9ba09166c 3p_integration folder updates 1 ano atrás
using_externally_hosted_llms.ipynb f9ba09166c 3p_integration folder updates 1 ano atrás

README.md

Running Llama 3 On-Prem with vLLM and TGI

This tutorial shows how to use Llama 3 with vLLM and Hugging Face TGI to build Llama 3 on-prem apps.