The core points of Alibaba’s design and deployment of 51.2T data center core network switches
Time:2023-11-13
Views:1571
In the era of artificial intelligence, network infrastructure has become a basic component of artificial intelligence training clusters. Alibaba‘s design approach to high-radix, high-speed 51.2T data center switches and support for linear pluggable optical (LPO) enables superior low latency and high power efficiency.
1.High performance RDMA network
2.Tigatron: Cornerstone of Alibaba HPN
3.Hardware Platform
1.High performance RDMA network
Large Radix scale out
Multi-rail communication
Adaptive Routing ready
Seamless integration
between SONIC and in-house automation systems
2.Tigatron: Cornerstone of Alibaba HPN
- Alibaba‘s 51.2T Fabric Switch
51.2Tbps Switch ASIC
Large radix 128x400GE QSFP112
PHY-Less VSR design
SONiC Inside
Power on and pass traffic since12/2022,MP since 07/2023
- Pluggable QSFP112 400GE optic
QSFP112 MSA compliant
400G-VR4/SR4,400G-DR4,400G-FR4,and Linear Pluggable Optic
3.Hardware Platform
Separate Data plane, Control Plane,and Management plane
Standard Open Control CPU Module:OCM
Standard BMC module
Removable Switch Module
Switch module can be easily removed from chassis, enabling composable design and multisource friendly
4.Linear Pluggable Optic
4.Linear Pluggable Optic
TH5 112G Peregrine DSP serdes iscapable ofinterfacing optic enginedirectly
The switch is designed to meet CEl112G-VSR-PAM4 spec, most of portshave higherILloss than CEl-112G-LINEARPAM4
Both SR4 and DR4 can meet e-6 BERunder different ambient scenarios,DR4 is more consistent than SR4,andhas better BER
5.Standardization ofLPO TP(Test Point)
5.Standardization ofLPO TP(Test Point)
Lower sensitivity ofLPO necessitating further enhancement of the TIA, CTLE andTX powerinside LPO
Interop with different DSPs requires additional testing for both LPO and DSPoptical modules.
System-level production centered around 51.2T switch chip is essential for LPO.
Better to be deployed in well-controlled end to end defined scenarios
Continuing advancements in semiconductor technology are driving innovation in switch ASICs, with 51.2Tbps ASICs being the most advanced switch chips available today; 102.4Tbps and 204.8Tbps switch ASICs are on the way, bringing huge improvements in speed and bandwidth.
Continuing advancements in semiconductor technology are driving innovation in switch ASICs, with 51.2Tbps ASICs being the most advanced switch chips available today; 102.4Tbps and 204.8Tbps switch ASICs are on the way, bringing huge improvements in speed and bandwidth.