DeepSeek’s up to date R1 reasoning AI mannequin could be getting the majority of the AI group’s consideration this week. However the Chinese language AI lab additionally launched a smaller, “distilled” model of its new R1, DeepSeek-R1-0528-Qwen3-8B, that DeepSeek claims beats comparably-sized fashions on sure benchmarks.
The smaller up to date R1, which was constructed utilizing the Qwen3-8B mannequin Alibaba launched in Might as a basis, performs higher than Google’s Gemini 2.5 Flash on AIME 2025, a set of difficult math questions.
DeepSeek-R1-0528-Qwen3-8B additionally almost matches Microsoft’s lately launched Phi 4 reasoning plus mannequin on one other math expertise take a look at, HMMT.
So-called distilled fashions like DeepSeek-R1-0528-Qwen3-8B are usually much less succesful than their full-sized counterparts. On the plus facet, they’re far much less computationally demanding. In accordance with the cloud platform NodeShift, Qwen3-8B requires a GPU with 40GB-80GB of RAM to run (e.g., an Nvidia H100). The complete-sized new R1 wants round a dozen 80GB GPUs.
DeepSeek educated DeepSeek-R1-0528-Qwen3-8B by taking textual content generated by the up to date R1 and utilizing it to fine-tune Qwen3-8B. In a devoted webpage for the mannequin on the AI dev platform Hugging Face, DeepSeek describes DeepSeek-R1-0528-Qwen3-8B as “for each tutorial analysis on reasoning fashions and industrial improvement centered on small-scale fashions.”
DeepSeek-R1-0528-Qwen3-8B is out there below a permissive MIT license, which means it may be used commercially with out restriction. A number of hosts, together with LM Studio, already supply the mannequin by way of an API.
{content material}
Supply: {feed_title}
