Instacart's Chief Connected Stores Officer, David McIntosh, discusses how AI and sensor fusion are transforming grocery shopping through the Caper Cart, a smart shopping cart powered by NVIDIA Jetson. The cart uses cameras, scales, and location sensors to provide a seamless experience, from running totals to personalized recommendations, with the long-term goal of unifying online and in-store shopping into a single AI-powered system.
Summarized by Podsumo
Instacart's Caper Cart uses multiple sensors (cameras, scales, location) and edge AI on NVIDIA Jetson to deliver real-time basket accuracy and recommendations, even in challenging store environments with poor Wi-Fi.
The smart cart has tripled deployment year-over-year, now in 100+ cities across the US, UK, and Australia, driving double-digit sales lifts for retailers.
Personalized features like 'Did you forget?' reminders (using online shopping history) alone increased sales by nearly 1% absolute lift.
Side-facing cameras on the cart build 3D maps of store shelves, enabling real-time inventory tracking and proactive restocking alerts for store employees.
Instacart envisions a unified shopping future where AI blends online and in-store experiences, potentially enabling hybrid models like pre-picked orders waiting in carts for customers.
quotes": [ "Our view is that in five to ten years, customers shouldn't have to think about shopping in-store or online. There will be one single unified mode powered by this continuously learning AI system." — David McIntosh
The magic of the product really sits at all of those three things coming together: sensor fusion physical AI running on the Jetson board at the edge, cloud AI systems, and a decade of online shopping data." — David McIntosh
As you digitize the store, you make it measurable, which means you can start to optimize it like software." — David McIntosh
"Our view is that in five to ten years, customers shouldn't have to think about shopping in-store or online. There will be one single unified mode powered by this continuously learning AI system. — David McIntosh"
"The magic of the product really sits at all of those three things coming together: sensor fusion physical AI running on the Jetson board at the edge, cloud AI systems, and a decade of online shopping data. — David McIntosh"
"As you digitize the store, you make it measurable, which means you can start to optimize it like software. — David McIntosh"