Arm AGI CPU Is Arm’s First Ever In-House CPU, Marketed Towards Hyperscalers And Datacenters

Arm has just announced its first-ever processor called AGI CPU, and like its name suggests, it’s making itself known in the race to AGI. While this company is a very familiar name in the semiconductor field where you can find its fingerprints all over the world, one distinction must be known: the British semiconductor designer actually did not produce a single processor throughout its 35-year history. The Arm AGI CPU marks the first.

Arm AGI CPU

Now, if you heard just a bit of tech-related news these days, there’s a good chance you have seen the acronym ‘AGI’ thrown around several times. It’s short for Artificial General Intelligence, which is supposedly a “brain” capable enough to outsmart humans and then some, and it’s exactly the reason why Arm decided to get its feet wet into the world of chipmaking. “As AI infrastructure scales globally, partners across the ecosystem are asking Arm to do more. The Arm AGI CPU was created to address this shift,” Arm’s press release reads.

Let’s get technical a bit: the new AGI CPU is quite the fiery monster of a CPU, with its leading-edge 3nm-class process node capable of cramming 136 Neoverse V3 cores at 3.7GHz clock speed, as well as support for up to 12-channel 6TB (yes, terabytes) of DDR5-8800 RAM with a sub-100ns of memory latency, along with 96 lanes of PCIe 6.0, Compute Express Link (CXL) 3.0 support, all packed in a palm-sized silicon that demands 300 watts of power.

Scale it up and wide, each 10U dual-node rack can pack 2 AGI CPUs with 272 cores, a 30-blade system can house 8160 cores, and case in point – Arm has partnered with Supermicro with a 200kW design that packs 336 of those chips totaling over 45,000 cores. That is to say, “more than 2x the performance per rack compared to the latest x86 systems,” and this is when AMD EPYCs are already known to feature copious amount of cores. Whew. To be fair, that claim came down to Arm touting its instruction set being superior at thread utilization, or in a more layman-ish term, more instructions per clock (IPC).

The company has already secured customers as it launched the new AGI CPU, with Meta being its “lead partner and customer” which helped developing the chip to work for the social media giant’s datacenter infrastructure. Other names in the launch partner roster include Cloudflare, OpenAI, SK Telecom, and more; systems with the new processor are now available via builders including ASRock Rack, Lenovo, and Supermicro.

Pokdepinion: I suppose chipmaking-capable companies like Microsoft and Amazon will still stick to their respective designs like the Azure Cobalt and Gravitons.