Why the iPhone Beats the Headset for AR Characters ft. Mark Drummond, CEO of Pixee

About this episode

Mark Drummond spent his Apple years building the character intelligence team behind Apple Vision Pro, working with Marvel and Jon Favreau to figure out how Hollywood IP could come to life in AR. Now, at his startup Pixee, he's making the opposite bet: forget the headset, the iPhone is the better device for bringing characters into people's lives. Mark walks Charlie and Ted through Pixee's vision — send a licensed character like Elsa to sing happy birthday through iMessage, no app required — and the underlying tech that makes it possible, including an engine built with Claude that replaced Unreal and cut compile times from an hour to seven minutes. The conversation goes deep on the Apple Vision Pro's real tradeoffs, the neurobiology of why the headset can feel exhausting after an hour, and why Mark thinks Apple's rumored "spectacles" will quietly inherit lessons from AVP's failures.

The news segment covers a big week of Big Tech earnings — Microsoft and Amazon soaring on cloud and ad growth, Meta and Apple taking hits — plus Anthropic's disclosure that its frontier AI models were used in real-world hacks, an AI-run vending machine experiment that lied to customers about refunds, the new ban on Chinese humanoid robot imports, and the growing backlash against AI smart glasses with outward-facing cameras.

Key Moments:

[01:35] Big Tech earnings and market winners/losers

[06:35] AI models behind real-world hacks

[09:35] Smart glasses and the "Glasshole" effect

[17:35] Mark Drummond joins — Pixee's origin story

[24:35] Apple Vision Pro history — what went wrong

[41:35] Headset vs. phone: the case for AR on iPhone

[50:35] Funding, protections, and the CDE philosophy

Brought to you by Zappar and Mattercraft, the leading visual development environment for immersive 3D web experiences. Start building at mattercraft.io.

Hosted on Acast. See acast.com/privacy for more information.