radu/LLamaRecipes @ bfa390fcd87ee85cc0c36fb99ccbce676440100e

Sanyam Bhutani ae010af7d8 move and add Difflog		před 10 měsíci
..
code_llama	ae010af7d8 move and add Difflog	před 10 měsíci
local_inference	ae010af7d8 move and add Difflog	před 10 měsíci
mobile_inference	ae010af7d8 move and add Difflog	před 10 měsíci
README.md	ae010af7d8 move and add Difflog	před 10 měsíci
modelUpgradeExample.py	ae010af7d8 move and add Difflog	před 10 měsíci

Quickstart > Inference

This folder contains scripts to get you started with inference on Meta Llama models.

Code Llama contains scripts for tasks relating to code generation using CodeLlama
Local Inference contains scripts to do memory efficient inference on servers and local machines
Mobile Inference has scripts using MLC to serve Llama on Android (h/t to OctoAI for the contribution!)
Model Update Example shows an example of replacing a Llama 3 model with a Llama 3.1 model.