radu/LLamaRecipes @ 95f42eeed3dc40a8df0e9e2c209cae407373bcde

Himanshu Shukla 95f42eeed3 Fixed spelling mistake		преди 11 месеца
..
code_llama	2f1cbfbbbf Merge remote-tracking branch 'upstream/main' into suraj-changes	преди 1 година
local_inference	95f42eeed3 Fixed spelling mistake	преди 11 месеца
mobile_inference	4487513793 Updating the folder name 3p_integrations	преди 1 година
README.md	d17e678659 Add Llama 3.1 example upgrade script (#5)	преди 1 година
modelUpgradeExample.py	d17e678659 Add Llama 3.1 example upgrade script (#5)	преди 1 година

Quickstart > Inference

This folder contains scripts to get you started with inference on Meta Llama models.

Code Llama contains scripts for tasks relating to code generation using CodeLlama
Local Inference contains scripts to do memory efficient inference on servers and local machines
Mobile Inference has scripts using MLC to serve Llama on Android (h/t to OctoAI for the contribution!)
Model Update Example shows an example of replacing a Llama 3 model with a Llama 3.1 model.