阿里云真武超节点Day0适配Kimi K3大模型，双方展开国产算力合作
Merged summary
TL;DR - Alibaba Cloud’s Zhenwu M890 supernode achieved Day-0 support for the nearly 3-trillion-parameter Kimi K3 model. The collaboration demonstrates domestic hardware’s ability to serve massive MoE models with improved latency and throughput.
- One instance interconnects 64 M890 GPUs at 800 GB/s and provides 9 TB of memory.
- Joint software-stack and kernel optimizations support up to a 1M-token context.
- Tests reportedly reduced time-to-first-token by about 35% and increased per-GPU decoding throughput by 1.8×.
- Alibaba Cloud’s Qwen AI platform and Model Studio will offer Kimi K3 APIs.
Sources (1)
阿里云真武超节点Day0适配Kimi K3大模型，双方展开国产算力合作
TL;DR - Alibaba Cloud’s Zhenwu M890 supernode achieved Day-0 support for the nearly 3-trillion-parameter Kimi K3 model. The collaboration demonstrates domestic hardware’s ability to serve massive MoE models with improved latency and throughput.
- One instance interconnects 64 M890 GPUs at 800 GB/s and provides 9 TB of memory.
- Joint software-stack and kernel optimizations support up to a 1M-token context.
- Tests reportedly reduced time-to-first-token by about 35% and increased per-GPU decoding throughput by 1.8×.
- Alibaba Cloud’s Qwen AI platform and Model Studio will offer Kimi K3 APIs.