radu/LLamaRecipes @ Tool_Calling_Demos

Sanyam Bhutani 5bc4b2727e Move Tool Notebooks		пре 8 месеци
..
code_llama	2f1cbfbbbf Merge remote-tracking branch 'upstream/main' into suraj-changes	пре 1 година
local_inference	d290678c84 Improve discoverability of 3.2 recipes	пре 9 месеци
mobile_inference	4487513793 Updating the folder name 3p_integrations	пре 1 година
README.md	d17e678659 Add Llama 3.1 example upgrade script (#5)	пре 11 месеци
modelUpgradeExample.py	d17e678659 Add Llama 3.1 example upgrade script (#5)	пре 11 месеци

Quickstart > Inference

This folder contains scripts to get you started with inference on Meta Llama models.

Code Llama contains scripts for tasks relating to code generation using CodeLlama
Local Inference contains scripts to do memory efficient inference on servers and local machines
Mobile Inference has scripts using MLC to serve Llama on Android (h/t to OctoAI for the contribution!)
Model Update Example shows an example of replacing a Llama 3 model with a Llama 3.1 model.