Nvidia Bets on Speed Over Core Count

The unglamorous chip in the AI story

When people talk about the AI boom, they talk about GPUs, the graphics-derived chips that do the heavy math. The humble CPU, the general-purpose brain of a computer, tends to get ignored. Nvidia would like to change that. It is now pitching its upcoming Arm-based Vera CPU with a phrase it seems rather proud of: a "max single-threaded CPU at scale."

That is a mouthful, so let's translate. A single thread is one continuous line of work a processor handles start to finish. Most big server chips brag about having lots of cores, meaning they can juggle many tasks at once. Nvidia is arguing that for AI, raw juggling isn't the point. Doing one thing fast is.

Why speed beats sheer numbers

Here is the logic. Modern reasoning AI works step by step. It runs the model, looks at the answer, then runs it again, over and over until it lands on a result. Each step depends on the one before it. You cannot start step two until step one is done, so throwing more cores at the problem doesn't help. What matters is how fast a single thread can chew through each step.

Agentic AI, where software "agents" carry out multi-step tasks on your behalf, has the same bottleneck. Agent B cannot begin until it knows what agent A did. It's a relay race, not a crowd. The speed of the runner matters more than the size of the crowd.

Vera is Nvidia's answer. It packs 88 cores (176 threads with a technique that lets each core handle two tasks) on a single monolithic chip, meaning one continuous piece of silicon rather than several smaller ones stitched together. Nvidia says that design keeps things predictable and well fed with data, quoting 1.2 TB/s of memory bandwidth and 3.4 TB/s of core-to-core bandwidth, the latter of which it claims is triple any other data center CPU.

The chiplet tax

That monolithic choice is a deliberate jab at rivals. To reach very high core counts, chips like Intel's Xeon and AMD's Epyc often use chiplets, smaller chip pieces linked together. Nvidia calls the downside a "chiplet tax": uneven memory access and inconsistent performance. Its single-die design, it says, sidesteps that. There is also a physics catch it points out. The more cores you cram in, the slower each one has to run to keep heat and power in check. Great for bulk work, less great for tasks you need finished right now.

Nvidia backs the pitch with customer numbers. Perplexity reportedly saw a 1.5x speedup in coding agent work and 1.9x running concurrent sandboxes. Database firm Starburst claims a 3x uplift in large-scale SQL analytics, and Redpanda reports a 6x drop in latency. Broadly, Nvidia says Vera is 1.8x faster than x86 competitors on agentic workloads.

Take the numbers with salt

Now the honest part. These are vendor-supplied benchmarks, and vendor benchmarks always deserve skepticism. Nvidia doesn't say exactly which Intel Xeon and AMD Epyc chips it compared against, though mid- to high-end models are a safe guess. And AMD has already pushed back on earlier independent tests by Phoronix, claiming a 3.3x advantage of its own when measured across a full 100 kW rack of hardware. Different framings, wildly different conclusions. That is normal in a field where a single day can move trillions of dollars.

What's next

Nvidia isn't standing still. It has already revealed a next-generation Arm core called Rigel, shipping in a future chip named Rosa, which it says will push per-core performance higher than Vera through better instruction handling, more cache, and improved memory management.

The bigger idea is worth watching. If agentic AI really does hinge on single-thread speed the way responsive personal computers always have, then Nvidia's design philosophy makes sense rather than being marketing dressing. The open question is whether Intel and AMD agree. If they start pitching "max single-threaded CPUs at scale" of their own, we'll know Nvidia framed the debate correctly.