radu/LLamaRecipes @ Tool_Calling_Demos

Sanyam Bhutani 5bc4b2727e Move Tool Notebooks		6 miesięcy temu
..
code_llama	2f1cbfbbbf Merge remote-tracking branch 'upstream/main' into suraj-changes	9 miesięcy temu
local_inference	d290678c84 Improve discoverability of 3.2 recipes	6 miesięcy temu
mobile_inference	4487513793 Updating the folder name 3p_integrations	9 miesięcy temu
README.md	d17e678659 Add Llama 3.1 example upgrade script (#5)	9 miesięcy temu
modelUpgradeExample.py	d17e678659 Add Llama 3.1 example upgrade script (#5)	9 miesięcy temu

Quickstart > Inference

This folder contains scripts to get you started with inference on Meta Llama models.

Code Llama contains scripts for tasks relating to code generation using CodeLlama
Local Inference contains scripts to do memory efficient inference on servers and local machines
Mobile Inference has scripts using MLC to serve Llama on Android (h/t to OctoAI for the contribution!)
Model Update Example shows an example of replacing a Llama 3 model with a Llama 3.1 model.