Sākums Izpētīt Palīdzība
Pierakstīties
radu
/
LLamaRecipes
spogulis no https://github.com/facebookresearch/llama-recipes.git
Vērot 1
Pievienot zvaigznīti 0
Atdalīts 0
Faili Problēmas 0 Vikivietne
Atzars: Remove-Tokenizer-onPrem-vllm-InferenceThroughput
Atzari Tagi
LLamaRecipes
/
recipes
/
inference
/
model_servers
Jeff Tang 6892ea1ac9 update readme and delete stale content 11 mēneši atpakaļ
..
hf_text_generation_inference 6d449a859b New folder structure (#1) 1 gadu atpakaļ
vllm 6d449a859b New folder structure (#1) 1 gadu atpakaļ
README.md 6892ea1ac9 update readme and delete stale content 11 mēneši atpakaļ
llama-on-prem.md 5cedef2155 Update llama-on-prem.md 1 gadu atpakaļ

README.md

Running Llama 3 On-Prem with vLLM and TGI

This tutorial shows how to use Llama 3 with vLLM and Hugging Face TGI to build Llama 3 on-prem apps.