top of page

Rewriting the Physics of AI: Cerebras

  • Jun 22
  • 4 min read

Cerebras is not building a better AI chip. It is rethinking how AI computation works. A single silicon wafer the size of a dinner plate, purpose-built for AI. While the rest of the industry slices wafers into thousands of tiny GPUs and then spends years stitching them back together with cables, Cerebras skipped the surgery. The result is an AI chip that runs inference up to 20 times faster than Nvidia's best at a fraction of the cost. That speed can create an entirely new market: real-time AI.


How it Started

The story starts on a whiteboard in late 2015. Five engineers who had spent years together at SeaMicro, the energy-efficient server company AMD had acquired for $334 million, sat down and wrote a single sentence. They wanted to do something important enough to land in the Computer History Museum.


Andrew Feldman put it bluntly in an Eclipse interview: "We weren't doing this to make money. We were doing this to see if we could pursue an idea that landed us in the Computer History Museum."


The problem that obsessed them was simple to state and brutally hard to solve. For more than twenty years, the semiconductor industry had accepted a hard physical ceiling called the reticle limit, which capped the size of any single chip at roughly the area of a postage stamp. Bigger models meant more chips, which meant more wiring between chips, which meant enormous amounts of time wasted moving data across copper instead of doing math.

The five founders believed the answer was heretical. Do not slice the wafer at all. Use the entire thing as one chip.


Everyone they consulted told them it was impossible. Trilogy Systems had tried and failed in the 1980s after raising more than $200 million. Intel could not do it with 100,000 people. Nvidia could not do it with 40,000. Feldman and his team of 85 did it anyway. When the first wafer powered on in a small lab in Los Altos, they stood and watched in silence. Seventy years of chip history had just changed.


The Breakthrough

Every chip you have ever used was born from a 300mm silicon wafer that got cut into hundreds of small rectangles. Cerebras refused to cut. The Wafer Scale Engine 3, its current generation, measures 46,225 square millimeters and contains four trillion transistors and 900,000 AI-optimized cores on a single piece of silicon. Nvidia's B200, the industry benchmark, measures 814 square millimeters. Cerebras packs 19 times more transistors and 28 times more compute into one processor.


The constraint is not raw compute. It is memory bandwidth. Large language models generate text one token at a time, and each token requires the chip to read the model's weights from memory. On a GPU, those weights sit on external HBM memory, which means the chip spends most of its time waiting for data to arrive. Cerebras eliminated that bottleneck by putting 44 gigabytes of memory directly onto the wafer, delivering 21 petabytes per second of bandwidth, which is roughly 7,000 times what an H100 offers. In practical terms, the wait is gone.


The New Market

 Five years ago, no market existed for a chip like this. Models were small enough to fit comfortably on GPU clusters, and latency was an afterthought. Then came ChatGPT and a wave of reasoning models, coding agents, and voice assistants where every second of delay destroyed the user experience. Inference, not training, became the dominant workload. Cerebras spent a decade building for a problem the world did not yet have. Now the world has it. This is not a faster GPU. It is a different kind of machine.


Look at this through a Blue Ocean lens and something interesting appears. Cerebras is not competing with Nvidia for the training market. It is creating a different one: real-time inference. Until now, AI product builders have had to design around latency. Voice assistants pause awkwardly. Coding agents make you wait. Reasoning models that think for twenty seconds before answering have been acceptable only because there was no alternative. When inference speeds jump by an order of magnitude, a different class of application becomes possible. Agents that can run hundreds of reasoning steps in the time a single response used to take. Voice interfaces indistinguishable from human conversation.


Financial systems that can evaluate thousands of model calls inside a single trade decision.

Mayo Clinic is building genomic foundation models to personalize rheumatoid arthritis treatment. The National Energy Technology Laboratory ran field equation simulations roughly 500 times faster than on its previous supercomputer. Researchers at Rice University and TotalEnergies achieved a 210x speedup on carbon capture simulations. Scientific institutions and industrial players who were priced out or timed out of large-scale AI, now have access to it.


Feldman's own framing captures the ambition. In the January 2026 press release, he said real-time inference will transform AI the way broadband transformed the internet. That is not a productivity claim. That is a platform shift. You do not get new behaviors from marginal speedups. You get them when latency stops being the limit.


The Competition

Cerebras operates in a field dominated by companies such as Nvidia, AMD, and emerging players like Groq. All of them aim to accelerate AI workloads, but they approach the problem differently. 


Most competitors focus on improving distributed systems. They build faster GPUs, optimize networking, and refine software layers that coordinate large clusters. Their goal is to make the existing paradigm more efficient.


Cerebras takes a different path. It removes the need for distributed coordination altogether. Instead of scaling out, it scales within a single system. This distinction is subtle but significant.


While GPU-based approaches improve productivity for existing users, Cerebras enables new modes of operation. It simplifies workflows, reduces engineering overhead, and enables real-time interaction at scale.


The competition, therefore, is not just about performance metrics. It is about architectural philosophy. Cerebras is betting that simplicity at scale will matter more than incremental improvements to complexity.



What's Next

Next issue we profile a company teaching AI to see the physical world in three dimensions, and the $100 billion market that emerges when machines finally understand space. If there is a market-creating AI company you think we should cover, reply and tell us. If you know a founder who should read this, forward it.


 
 
 

Comments


bottom of page