LLamaRecipes/getting-started/distillation/README.md

Distillation with Llama 4 and Synthetic Data Kit

Copyright (c) Meta Platforms, Inc. and affiliates. This software may be used and distributed according to the terms of the Llama Community License Agreement.*

This notebook will walk you through distilling model knowledge from Llama 4 into a smaller Llama 3.2 model using synthetic training data from Synthetic Data Kit.

View notebook