Pia Papanna
f9ba09166c
3p_integration folder updates
|
11 ヶ月 前 | |
|---|---|---|
| .. | ||
| aws | 11 ヶ月 前 | |
| azure | 11 ヶ月 前 | |
| groq | 11 ヶ月 前 | |
| lamini | 11 ヶ月 前 | |
| octoai | 11 ヶ月 前 | |
| tgi | 11 ヶ月 前 | |
| vllm | 11 ヶ月 前 | |
| README.md | 11 ヶ月 前 | |
| llama_on_prem.md | 11 ヶ月 前 | |
| using_externally_hosted_llms.ipynb | 11 ヶ月 前 | |
README.md
Running Llama 3 On-Prem with vLLM and TGI
This tutorial shows how to use Llama 3 with vLLM and Hugging Face TGI to build Llama 3 on-prem apps.