Supermicro to Build and Sell SambaNova-Powered AI Inference Systems

PUBLISHER ARTICLE PREVIEW

From the original article

SambaNova and Supermicro announced on November 3, 2026 that Supermicro will build, sell and support AI inference systems that divide the work between NVIDIA GPUs and SambaNova’s SN50 Reconfigurable Dataflow Units. The collaboration is initially planning for 10,000 SN50 chips.

The systems will join Supermicro’s Data Center Building Block Solutions portfolio. Supermicro will integrate, test, deliver and support them, including on-site service, while SambaNova engineers will get models running and tuned on SN50 and assist with customer deployments. The arrangement therefore pairs a server manufacturing and service channel with the model-engineering work required for a heterogeneous accelerator deployment.

The architecture divides inference into its two phases. During prefill, NVIDIA GPUs process the incoming prompt, a compute-bound task. SN50 RDUs handle decode, which generates the response one token at a time and is memory-bound. SambaNova says assigning each phase to suitable hardware delivers faster and more efficient inference than either hardware type alone.

SambaNova’s accompanying announcement makes agentic AI the central use case: agents can make thousands of calls to large language models, each call can take minutes, and agentic workloads spend most of their time in decode. That puts token generation on the critical path for an agent’s next action. The companies are consequently treating decode as a distinct infrastructure problem, with additional RDUs intended to accelerate responses while GPUs continue handling prompt processing.

SN50 is SambaNova’s fifth-generation RDU.