Nvidia starts shipping TSMC-backed CPO switches to tackle AI data centre bottlenecks
Taipei, June 4
Nvidia Corp has announced that it has started shipping its next-generation co-packaged optics switches, developed in collaboration with Taiwan Semiconductor Manufacturing Co., as the US tech giant seeks to address data transmission and power consumption challenges in AI data centres, according to a report by Focus Taiwan.
Speaking at Nvidia GTC Taipei on Wednesday (local time), Gilad Shainer, Senior Vice President of Networking at Nvidia, said the company has begun supplying its new Spectrum-X CPO switch to select partners.
According to the report, the switch incorporates Nvidia's most advanced CPO technology and delivers throughput of up to 400 terabits per second, he said, adding that production capacity is expected to increase during the second half of the year.
CPO switches are networking devices that integrate optical engines -- components that convert electrical signals into optical signals -- directly with switch chips, which route data between servers and processors, to transmit data more efficiently while reducing power consumption.According to the report, Shainer said that the push comes as AI factories rapidly expand their computing capacity, making bandwidth and power consumption between server racks in data centers key factors affecting AI performance.
These server racks contain equipment such as servers, GPUs and switches that process and transmit data within AI data centres.
He noted that Nvidia is pushing ahead with CPO technology as a key approach to maximising the performance-to-power ratio in AI factories.
According to Shainer, CPO technology allows Nvidia to move beyond conventional designs that place optical transceivers outside switches by integrating and packaging optical engines directly with switch chips, thereby minimizing power consumption and transmission distances.
TSMC has played an important role in the packaging process, with the two companies working together to adopt the chipmaker's new COUPE (compact universal photonic engine, silicon photonics packaging platform, he said.
The innovation allows optical engines, switch chips and related components to be packaged together in a highly reliable and flexible way, paving the way for volume production, Shainer added.
At the event, Shar Narasimhan, Nvidia's director of product marketing for data center GPUs and AI training, said Taiwan's technology ecosystem has been a valuable partner in enabling technologies that support the company's expanding AI systems.
He said Taiwan's supply chain has two core strengths -- being "hard-working" and having "very advanced technology" -- making it an indispensable partner for Nvidia.
According to the report, Narasimhan said that with global demand for AI computing power already far exceeding available computing capacity, Nvidia needs Taiwan's ecosystem to help expand production for AI factories around the world.
— ANI
Reader Comments
Interesting that Nvidia keeps praising Taiwan's ecosystem. While their tech is undeniably advanced, India also has strong semiconductor design talent (look at what companies like Intel, AMD, and Qualcomm do in Bangalore/Hyderabad). Wish Indian fab ecosystem was as advanced - we're decades behind TSMC. Need faster execution on our semiconductor policy!
CPO technology is a game-changer for power efficiency. As someone working in data centre cooling, I can tell you the current power consumption of modern AI clusters is insane. This reduces both latency and energy costs. Good to see Nvidia pushing boundaries. India's data centre market is exploding (Noida, Mumbai, Hyderabad) - this tech will benefit our hyperscalers too.
Honestly, while this is impressive, I wish our Indian companies like Tata Consultancy Services or Infosys could also play in this space. We're still mostly consumers of such tech. Need to move up the value chain in semiconductor and optics manufacturing. At least the government's Rs 76,000 crore semiconductor scheme is a start.
I work in networking and CPO is indeed the future. But let's be practical - this is still early stage. Nvidia is shipping to select partners only. Volume production in H2 2025 means it'll take time to trickle down. Still, India's AI researchers (IITs, IISc) will benefit from more efficient infrastructure. Hope Mukesh Ambani's Jio and others take note!
Impressive specs - 400 Tbps! As someone from the US,
We welcome thoughtful discussions from our readers. Please keep comments respectful and on-topic.