Home Explore Help
Sign In
radu
/
LLamaRecipes
mirror of https://github.com/facebookresearch/llama-recipes.git
Watch 1
Star 0
Fork 0
Files Issues 0 Wiki
Tree: bbc55b4069
Branches Tags
LLamaRecipes
/
recipes
/
3p_integration
/
azure
Suraj Subramanian bbc55b4069 Merge remote-tracking branch 'upstream/main' into chester-benchmarks 1 year ago
..
README.md bbc55b4069 Merge remote-tracking branch 'upstream/main' into chester-benchmarks 1 year ago
azure_api_example.ipynb bbc55b4069 Merge remote-tracking branch 'upstream/main' into chester-benchmarks 1 year ago

README.md

In this folder, we show various examples in a notebook for running Llama model inference on Azure's serverless API offerings. We will cover:

  • HTTP requests API usage for Llama 3 instruct models in CLI
  • HTTP requests API usage for Llama 3 instruct models in Python
  • Plug the APIs into LangChain
  • Wire the model with Gradio to build a simple chatbot with memory