Invest Like the Best with Patrick O'Shaughnessy

Krishna Rao - Anthropic's CFO on Compute, Scaling to $30B ARR, and the Returns to Frontier Intelligence - [Invest Like the Best, EP.471]

1h 17min

Krishna Rao, CFO of Anthropic, discusses how managing compute is the lifeblood of the company, describing it as the canvas on which everything else is built. He explains the 'cone of uncertainty' in procuring compute, the fungible use of three chip platforms, and the high returns from investing in frontier intelligence, especially in enterprise. The conversation covers Anthropic's rapid growth to a $30 billion annual revenue run rate and the strategic challenges of scaling an exponential business.

Summarized by Podsumo

🎧 Listen 🎙️ Ask about this episode

✨ Key Takeaways

1

Compute management is central to Anthropic's business, with Rao spending 30-40% of his time on it, including daily allocation meetings that balance training, research, internal use, and customer demand.
2

Anthropic uses three chip platforms (Amazon Trainium, Google TPUs, and NVIDIA GPUs) fungibly, having built an orchestration layer to dynamically allocate compute for maximum efficiency across various workloads.
3

The returns to frontier intelligence are high, especially in enterprise, with a net dollar retention rate over 500% and nine of the Fortune 10 as customers. Rao notes the business scaled from $9B to $30B annual run rate revenue in four months.
4

Model efficiency improves significantly with each new generation, creating a win-win where newer models are both more capable and more efficient to serve, enabling dynamic improvement even between model releases.
5

Anthropic's culture is deeply collaborative, transparent, and mission-driven, which helps retain top talent despite not always paying the highest compensation, with most co-founders and early employees still at the company.

💬 Notable Quotes

"The compute that we procure is the lifeblood of our business. It is the most important thing in the company. It's like the canvas on which everything else gets built."

— Krishna Rao
"The returns to frontier intelligence are extremely high. And it's extremely high especially in enterprise."

— Krishna Rao
"Today, 90 plus percent of our code is actually written by Cloud Code. A lot of Claude's code is written by Claude's code."

— Krishna Rao