Routing Wars: Which Model Gets the Workload?

About this episode

66% of enterprise AI teams are actively engineering toward zero human oversight — but only 4.5% fully trust their automated evals. Half have already shipped an agent that passed evals and still failed a real customer.

VentureBeat's latest research exposes a dangerous gap between deployment ambition and evaluation maturity. The most-used eval platform is OpenAI's native tooling. The second most common answer: no dedicated eval platform at all. Meanwhile, 51% of enterprises are relying on a hyperscaler's built-in guardrails as their primary AI security layer — not a deliberate security architecture.

Fable's 19-day market absence changed the conversation. Enterprises that had built production workflows on frontier models got a wake-up call about single-vendor dependency. The result: GLM 5.2 is gaining serious developer traction as an open alternative competitive with Opus 4.8, and Tencent's new Hai 3 — less than half the size — is drawing attention for agentic workloads that don't require cutting-edge coding performance. Sam and Matt break down why companies like Shopify, LinkedIn, and Pinterest were already on open models, and why others are now catching up fast.

On infrastructure: neo-clouds are currently used by just 2% of respondents, but 45% name them as their top planned investment area over the next 12 months. The market hasn't calcified. Matt and Sam preview what they expect to hear at VentureBeat Transform from engineering leaders at Intuit, Brex, Instacart, and Mastercard — including how Intuit bootstrapped and pivoted its agent architecture mid-build, and why agent conversations are generating higher-quality behavioral data than traditional user research ever did.

🎙️ HOSTS: Matt Marshall · Sam Witteveen | VentureBeat

__

If you enjoy these conversations, you need to be in Menlo Park this July.

VB Transform 2026 is VentureBeat's flagship enterprise AI event, built entirely around one question: How do you orchestrate AI autonomy at scale? July 14–15, Hotel Nia. Real projects, proprietary research, no fluff.

50% off for listeners with code BEYONDTHEPILOT: https://bit.ly/4fK4F6z

—

Chapters:

00:00 Research data drop: eval gaps, zero-HITL targets, and hyperscaler security dependency

01:00 Chinese models breaking into enterprise — developer fad or structural shift?

02:00 GLM 5.2 and Tencent Hai 3: what they do well and where they fall short

03:20 How Shopify, LinkedIn, and Pinterest are already running open models in production

05:40 Fable's 19-day outage: why 19 days changed enterprise AI vendor strategy

07:00 Intuit's agent build: bootstrapping, mid-build pivots, and real-time behavioral data

08:40 Neo-cloud infrastructure: 2% current usage, 45% planned investment next 12 months

09:20 Is the enterprise AI market still wide open? Anthropic vs. OpenAI for enterprise lead

11:20 The routing question: when do you send workloads to smarter vs. cheaper models?

12:20 Transform preview: what to expect from Amazon, Databricks, Brex, Instacart, Mastercard

---

Subscribe to VentureBeat: https://www.youtube.com/@VentureBeat

Apple Podcasts: https://podcasts.apple.com/us/podcast/venturebeat/id1839285239

Spotify: https://open.spotify.com/show/4Zti73yb4hmiTNa7pEYls4

Website: https://venturebeat.com

LinkedIn: https://www.linkedin.com/company/venturebeat

Newsletter: https://venturebeat.com/newsletters

#EnterpriseAI #AIAgents #LLM #MLOps #AgenticAI

—

Learn more about your ad choices. Visit megaphone.fm/adchoices