radu/LLamaRecipes @ update-prompt-guard-tutorial

Matthias Reso 01a20d1e86 Remove max_length from tokenization (#604)		před 9 měsíci
..
code_llama	2f1cbfbbbf Merge remote-tracking branch 'upstream/main' into suraj-changes	před 9 měsíci
local_inference	01a20d1e86 Remove max_length from tokenization (#604)	před 9 měsíci
mobile_inference	4487513793 Updating the folder name 3p_integrations	před 9 měsíci
README.md	d17e678659 Add Llama 3.1 example upgrade script (#5)	před 9 měsíci
modelUpgradeExample.py	d17e678659 Add Llama 3.1 example upgrade script (#5)	před 9 měsíci

Quickstart > Inference

This folder contains scripts to get you started with inference on Meta Llama models.

Code Llama contains scripts for tasks relating to code generation using CodeLlama
Local Inference contains scripts to do memory efficient inference on servers and local machines
Mobile Inference has scripts using MLC to serve Llama on Android (h/t to OctoAI for the contribution!)
Model Update Example shows an example of replacing a Llama 3 model with a Llama 3.1 model.