Ship Happens
Ship Happens

Why Enterprise AI Is Really an Infrastructure Problem | Colton Shaw, Spectro Cloud

24 July 2026 1:21:58 Docker

Listen to episode

About this episode

Everyone is talking about AI models—but the hardest part of enterprise AI isn't choosing a model. It's building the infrastructure to run it securely, reliably, and at scale.

In this episode, Docker's Per Krogslund is joined by Colton Shaw, Principal Architect at Spectro Cloud, for a conversation about the often-overlooked foundation of enterprise AI. They discuss why incidents like Log4Shell transformed software supply chain security, how Software Bills of Materials (SBOMs) provide visibility into application dependencies, and why AI-generated code introduces new governance challenges.

Colton also shares lessons from deploying Kubernetes across highly regulated and air-gapped public sector environments, explains why edge AI is reshaping industries from defense to healthcare, and discusses how organizations can balance open-source innovation with enterprise-grade security, resiliency, and operational control.

Whether you're modernizing cloud infrastructure, evaluating AI platforms, or preparing your organization for production AI, this episode offers practical insights into building systems that are secure, flexible, and ready for the future.

 

 

In This Episode You'll Hear

  • Why enterprise AI is fundamentally an infrastructure challenge
  • How Log4Shell changed software supply chain security forever
  • What Software Bills of Materials (SBOMs) are and why they matter
  • The risks AI-generated code introduces into enterprise environments
  • How hardened and distroless containers reduce attack surfaces
  • The realities of deploying Kubernetes in air-gapped environments
  • Why edge AI requires a different operational mindset than cloud AI
  • How model routing reduces vendor lock-in and improves resiliency
  • The tradeoffs between proprietary and open-source AI models
  • Why governance, auditability, and human oversight remain essential as AI scales

 

 

Timestamps

(00:00) Welcome to Ship Happens

(00:38) Meet Colton and Spectro Cloud

(01:22) Why SBOMs Matter for Enterprise AI

(03:57) The Log4Shell Wake-Up Call

(07:19) Hardening Containers for AI Workloads

(09:33) Security Requirements in Regulated Industries

(14:16) What Spectro Cloud Does

(15:54) Kubernetes in Air-Gapped Defense Environments

(19:16) Why AI Infrastructure Is Different

(20:45) The Current State of AI Operations

(24:24) Budgeting for AI: Tokens vs. Talent

(26:28) AI Sovereignty and Avoiding Vendor Lock-In

(29:58) Building and Serving Your Own Models

(32:54) Choosing the Right AI Model

(36:52) Model Routing for Reliability and Resilience

(40:33) Designing Invisible AI Failover

(41:02) Managing Developer Complexity

(43:45) AI Development Environments at Scale

(45:04) Edge AI in the Real World

(52:28) Why Human-in-the-Loop Still Matters

(58:22) Governance, Audit Trails, and Responsible AI

(01:05:20) Open-Source vs. Proprietary Models

(01:11:46) Moving Beyond APIs to AI Strategy

(01:17:39) Closing Predictions

 

About the Guest

Colton Shaw is a Principal Architect at Spectro Cloud, where he helps public sector and enterprise organizations design, deploy, and secure Kubernetes platforms across cloud, edge, and air-gapped environments. His work focuses on modern infrastructure, software supply chain security, AI governance, and helping organizations operationalize AI in highly regulated industries, including defense and government. With deep expertise in Kubernetes, container security, and edge computing, Colton works with teams building resilient platforms that support mission-critical applications at scale.

 

Links & Resources

🌐 Learn more about Spectro Cloud: https://www.spectrocloud.com

🐳 Learn more about Docker: https://www.docker.com

☸️ Kubernetes Documentation: https://kubernetes.io

🛡️ Learn more about Software Bills of Materials (SBOMs): https://www.cisa.gov/sbom

📄 Learn more about the Log4Shell vulnerability: https://www.cisa.gov/news-events/cybersecurity-advisories/aa21-356a


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Want to find AI jobs?

Join thousands of AI professionals finding their next opportunity

We respect your inbox. Unsubscribe at any time.

© 2026 Ship Happens. All rights reserved.

Common Questions

Frequently asked questions

Quick answers about how DevFound's AI matching, resumes, and referrals work.

DevFound's AI Copilot ingests your profile, goals, and live job data to deliver curated matches in seconds. Every match includes a resume variant, suggested referrals, and interview prep so you can act immediately. The more feedback you provide, the sharper the Copilot becomes.

AI-led job searches shrink the hours spent sifting through boards and formatting resumes. DevFound pairs automation with your personal outreach, so you reserve energy for interviews and negotiation. Traditional networking still matters, but AI gives you a lift before you even send a message.

Modern AI roles expect comfort with production-grade code, data fluency, and practical ML tooling. The strongest candidates pair deep technical chops with storytelling—translating model impact to product, GTM, and exec partners. Continuous learning keeps you ahead as stacks evolve.

DevFound rewards active seekers. Keep your profile fresh, respond to match quality prompts, and enable alerts so you never miss a role. The AI prioritizes companies and teams that align with your feedback, accelerating both introductions and interview invites.

High-density tech hubs continue to host the deepest AI talent pools, yet distributed teams are catching up fast. Use DevFound filters to hone in on onsite, hybrid, or fully remote roles and watch openings expand across time zones.

DevFound aggregates thousands of remote AI openings and flags the nuances—core hours, async culture, and visa needs—up front. The Copilot also recommends how to position your distributed work experience so hiring managers know you can thrive on a remote team.