A flurry of developments in late January 2025 has caused quite a buzz in the AI world. On January 20, DeepSeek released a new open-source AI ...

The Microsoft piece also goes over various flavors of distillation, including response-based distillation, feature-based ...

Since the Chinese AI startup DeepSeek released its powerful large language model R1, it has sent ripples through Silicon ...

David Sacks says OpenAI has evidence that Chinese company DeepSeek used a technique called "distillation" to build a rival ...

Also read: DeepSeek AI: How this free LLM is shaking up AI industry Model distillation, or knowledge distillation, addresses this challenge by transferring the knowledge of a large model into a ...

AI-driven knowledge distillation is gaining attention. LLMs are teaching SLMs. Expect this trend to increase. Here's the ...

Things are moving quickly in AI — and if you’re not keeping up, you’re falling behind. Two recent developments are reshaping the landscape for developers and enterprises ali ...

AI researchers at Stanford and the University of Washington were able to train an AI “reasoning” model for under $50 in cloud compute credits, according to a new research paper released last Friday.

In response to pressure from rivals including Chinese AI company DeepSeek, OpenAI is changing the way its newest AI model, o3 ...

Researchers from Stanford and Washington developed an AI model for $50, rivaling top models like OpenAI's o1 and DeepSeek.