Home Explore Help
Sign In
radu
/
LLamaRecipes
mirror of https://github.com/facebookresearch/llama-recipes.git
Watch 1
Star 0
Fork 0
Files Issues 0 Wiki
Branch: subramen-patch-1
Branches Tags
LLamaRecipes
/
recipes
/
3p_integrations
Pia Papanna e31a2dac19 Deleting Agents folder and adding llamaindex 10 months ago
..
aws 4487513793 Updating the folder name 3p_integrations 10 months ago
azure 4487513793 Updating the folder name 3p_integrations 10 months ago
groq 4487513793 Updating the folder name 3p_integrations 10 months ago
lamini 4487513793 Updating the folder name 3p_integrations 10 months ago
langchain 7488295577 Update langgraph_tool_calling_agent.ipynb 10 months ago
llamaindex e31a2dac19 Deleting Agents folder and adding llamaindex 10 months ago
octoai 4487513793 Updating the folder name 3p_integrations 10 months ago
tgi 4487513793 Updating the folder name 3p_integrations 10 months ago
vllm 4487513793 Updating the folder name 3p_integrations 10 months ago
README.md 4487513793 Updating the folder name 3p_integrations 10 months ago
llama_on_prem.md 4487513793 Updating the folder name 3p_integrations 10 months ago
using_externally_hosted_llms.ipynb 4487513793 Updating the folder name 3p_integrations 10 months ago

README.md

Running Llama 3 On-Prem with vLLM and TGI

This tutorial shows how to use Llama 3 with vLLM and Hugging Face TGI to build Llama 3 on-prem apps.