Sākums Izpētīt Palīdzība
Pierakstīties
radu
/
LLamaRecipes
spogulis no https://github.com/facebookresearch/llama-recipes.git
Vērot 1
Pievienot zvaigznīti 0
Atdalīts 0
Faili Problēmas 0 Vikivietne
Atzars: suraj-refactor-patch
Atzari Tagi
LLamaRecipes
/
recipes
/
3p_integration
Pia Papanna f9ba09166c 3p_integration folder updates 1 gadu atpakaļ
..
aws f9ba09166c 3p_integration folder updates 1 gadu atpakaļ
azure f9ba09166c 3p_integration folder updates 1 gadu atpakaļ
groq f9ba09166c 3p_integration folder updates 1 gadu atpakaļ
lamini f9ba09166c 3p_integration folder updates 1 gadu atpakaļ
octoai f9ba09166c 3p_integration folder updates 1 gadu atpakaļ
tgi f9ba09166c 3p_integration folder updates 1 gadu atpakaļ
vllm 8dc0578702 Fixing broken file paths 1 gadu atpakaļ
README.md f9ba09166c 3p_integration folder updates 1 gadu atpakaļ
llama_on_prem.md f9ba09166c 3p_integration folder updates 1 gadu atpakaļ
using_externally_hosted_llms.ipynb f9ba09166c 3p_integration folder updates 1 gadu atpakaļ

README.md

Running Llama 3 On-Prem with vLLM and TGI

This tutorial shows how to use Llama 3 with vLLM and Hugging Face TGI to build Llama 3 on-prem apps.