Teaching a smaller model
Small language models and how they get good: distillation trains a compact student to imitate a large teacher's outputs (or reasoning traces), capturing most of the capability at a fraction of the cost. When a 3B model fine-tuned on your task beats a frontier API on latency, price, and privacy.