The Medium post goes over various flavors of distillation, including response-based distillation, feature-based distillation and relation-based distillation. It also covers two fundamentally different modes of distillation – off-line and online distillation.

David Sacks says OpenAI has evidence that Chinese company DeepSeek used a technique called "distillation" to build a rival model.

OpenAI accuses Chinese AI firm DeepSeek of stealing its content through "knowledge distillation," sparking concerns over security, ethics, and national interests.

OpenAI believes DeepSeek used a process called “distillation,” which helps make smaller AI models perform better by learning from larger ones.

After DeepSeek AI shocked the world and tanked the market, OpenAI says it has evidence that ChatGPT distillation was used to train the model.

DeepSeek built top-performing AI models using less-advanced chips at what it says is a fraction of the cost of rivals such as OpenAI.

OpenAI—which faces multiple lawsuits for using content without permission—accuses DeepSeek of 'distillation,' a technique that use larger models' outputs to improve smaller ones.

OpenAI has accused Chinese AI start-up DeepSeek of using its proprietary models to train an open-source competitor.

DeepSeek, a Chinese AI research lab, has released an advanced AI model which rivals leading models from OpenAI. The DeepSeek-R1 model can perform complicated mathematical reasoning, code generation, and more with fewer resources than its American competitors.