The updates could help OpenAI compete better with rivals such as Anthropic, Google, and AWS which already offer similar capabilities. In what can only be seen as OpenAI’s efforts to catch up with ...
DeepSeek’s R1 release has generated heated discussions on the topic of model distillation and how companies may protect against unauthorized distillation. Model distillation has broad IP implications ...
Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Vivek Yadav, an engineering manager from ...
When DeepSeek-R1 launched recently, it immediately captured the attention of the global artificial intelligence community, prompting major players such as OpenAI, Microsoft, and Meta to investigate ...
Model distillation is one of the technology trends that has reached a level of maturity identified in Gartner’s 2025 Hype Cycle for artificial intelligence (AI) as “the slope of enlightenment”.
Hosted on MSN

What is AI Distillation?

Distillation, also known as model or knowledge distillation, is a process where knowledge is transferred from a large, complex AI ‘teacher’ model to a smaller and more efficient ‘student’ model. Doing ...
Forbes contributors publish independent expert analyses and insights. There’s a new wrinkle in the saga of Chinese company DeepSeek’s recent announcement of a super-capable R1 model that combines high ...
Large language models (LLMs) such as GPT-4o and other modern state-of-the-art generative models like Anthropic’s Claude, Google's PaLM and Meta's Llama have been dominating the AI field recently.