distillation

1 article tagged with distillation

March 26, 2026
product updateApple

Apple gains full Gemini access, uses distillation to build lightweight on-device models

Apple has secured full access to Google's Gemini models within its data centers and is using knowledge distillation to generate training data for smaller, on-device AI models. The approach allows Apple to create lightweight versions that replicate Gemini's reasoning patterns while running directly on Apple devices, requiring significantly less processing power.