Connor Treacy
6160b77724
Add README for distillation process with Llama 4 (#1010)
|
vor 2 Tagen | |
|---|---|---|
| .. | ||
| README.md | vor 2 Tagen | |
| distillation.ipynb | vor 2 Tagen | |
README.md
Distillation with Llama 4 and Synthetic Data Kit
Copyright (c) Meta Platforms, Inc. and affiliates. This software may be used and distributed according to the terms of the Llama Community License Agreement.*
This notebook will walk you through distilling model knowledge from Llama 4 into a smaller Llama 3.2 model using synthetic training data from Synthetic Data Kit.