DataFramed

#351 Will World Models Bring us AGI? with Eric Xing, President & Professor at MBZUAI

1h 4min

Eric Xing, President & Professor at MBZUAI, discusses the potential of World Models to achieve AGI, defining them as simulators of the physical and social world. He introduces his team's Pan World Model, which combines symbolic LLM reasoning with diffusion-based generation, and highlights its applications in robotics, gaming, and autonomous driving. Xing also details K2-Think V2, a fully open-source LLM, and his ambitious work on digital organisms to revolutionize drug development through biological simulation.

Summarized by Podsumo

🎧 Listen 🎙️ Ask about this episode

✨ Key Takeaways

1

World Models are presented as simulators, not predictors, of the real world, trained on multi-modal data to enable autonomous learning for AI agents and crucial for developing 'physical intelligence' beyond mere 'book intelligence'.
2

Eric Xing's Pan World Model features a unique mixed backbone architecture, combining a large language model for long-term symbolic reasoning with a diffusion-based model for high-resolution, short-range consistency, aiming to facilitate both intuitive and deliberate AI reasoning.
3

K2-Think V2 is highlighted as a 100% sovereign, in-house built, completely open-source LLM, including model weights, training data, and recipes, promoting transparency, reproducibility, and safety in the AI research community.
4

A significant challenge for current World Models is achieving long-horizon consistency and planning, which Eric's team addresses through architectural innovations to maintain coherent simulations over extended periods.
5

The concept of digital organisms, a specialized type of World Model for biology, is introduced as a disruptive approach to drug development, aiming to simulate virtual cells and organisms to drastically reduce the cost and risk of scientific experimentation.

💬 Notable Quotes

"War Model is not a predictor. War Model is a simulator."
"It is the first time that you see a frontier model which is able to be open-source both in model weights but also the data, the training recipe and so forth so that people can really take it away and reproduce it."
"The Wright Brothers aircraft is really primitive... But the moment people see it, people know that it is not a car. It is not a horsebacking. It is something flying in the air. Then only a few years later, people are already using the aircraft to do their battle in World War I. So once you see the prototype, the next iteration will be extremely fast."