Invest Like the Best with Patrick O'Shaughnessy

Dylan Patel - The Infinite Demand for Tokens, Claude Mythos, and Supply Constraints - [Invest Like the Best, EP.468]

47 min

Dylan Patel discusses the explosive, nearly unbounded demand for frontier AI models, exemplified by his firm's AI spend skyrocketing to a $7 million run rate. He highlights how these models enable individuals to achieve the work of large teams, driving unprecedented value creation. This demand is severely constrained by bottlenecks across the semiconductor supply chain, particularly in memory and logic, leading to expanding margins for hardware providers and a potential concentration of economic power.

Summarized by Podsumo

🎧 Listen 🎙️ Ask about this episode

✨ Key Takeaways

1

Explosive AI Spend: Dylan's firm's AI token spend surged from tens of thousands to a $7 million annual run rate, representing over 25% of salary expense, demonstrating the intense demand for frontier models.
2

Implementation is Easy, Ideas are Key: AI has made execution incredibly cheap and fast, shifting the value to identifying the right ideas to implement and effectively capturing the value generated by AI.
3

Unbounded Demand for Frontier Models: Users are "insistent" on the newest, most capable (and expensive) AI models like Anthropic's Mythos/Opus, leading to Anthropic's gross margins soaring to 72%+ despite high prices.
4

Severe Supply Bottlenecks: The entire semiconductor supply chain, especially DRAM memory, faces critical capacity constraints with lead times extending years, predicting memory prices to "double and triple again."
5

Societal Reordering & Protests: The rapid advancement and economic impact of AI are expected to cause a "complete re-ordering of how economies work," with Dylan predicting "large scale protests against Anthropic and OpenAI" in the near future.

💬 Notable Quotes

"If you don't adopt AI, someone else will and they will beat me."

— Dylan Patel
"The frontier model is the only model anyone wants and willingness to pay for it is nearly unbounded."

— Dylan Patel
"Ultimately you keep making things cheaper and then you keep scaling them up and you keep getting humongous improvements."

— Dylan Patel