The Information Bottleneck
The Information Bottleneck

RL Was Broken at Every Level - With Joseph Suarez (PufferAI)

30 July 2026 1:03:28 Ravid Shwartz-Ziv & Allen Roush

Listen to episode

About this episode

In this episode, Joseph Suarez from PufferAI explains why he thinks RL never had an algorithm problem, but it had a code problem. Every part of the standard RL stack was running about a thousand times slower than it should have been, and once that got fixed, problems that used to take months started getting solved in seconds on one GPU. We talk about what makes a simulator good for RL, why most of their sims run on CPU, what he wants to do with scientific simulation, and why he open sources all of it instead of writing papers.


Key topics

  • Types of RL and their applications
  • Challenges in scaling reinforcement learning
  • The role of simulators and hardware in RL
  • RL in gaming: from chess to complex games like NetHack and RuneScape
  • Future directions: scientific simulation and biological modeling

Chapters

00:00 - Introduction to RL and Puff AI

01:50 - Different settings for RL: Games, Robots, Finance

04:10 - RL in LM and other domains

07:00 - Challenges and solutions in RL scaling

09:55 - Building fast, efficient simulators

15:10 - RL for scientific research and simulation

19:57 - RL in complex games: NetHack, RuneScape, Dwarf Fortress

29:55 - Future of RL: Scientific discovery and beyond


Resources

Puff AI - Official Site - https://puffer.ai

NetHack - https://www.nethack.org/

RuneScape - https://www.runescape.com/

Dwarf Fortress - http://www.bay12games.com/dwarves/

OpenAI Gym - https://github.com/openai/gym


Music

  • "Kid Kodi" - Blue Dot Sessions - via Free Music Archive - CC BY-NC 4.0.

Want to find AI jobs?

Join thousands of AI professionals finding their next opportunity

We respect your inbox. Unsubscribe at any time.

© 2026 The Information Bottleneck. All rights reserved.

Common Questions

Frequently asked questions

Quick answers about how DevFound's AI matching, resumes, and referrals work.

DevFound's AI Copilot ingests your profile, goals, and live job data to deliver curated matches in seconds. Every match includes a resume variant, suggested referrals, and interview prep so you can act immediately. The more feedback you provide, the sharper the Copilot becomes.

AI-led job searches shrink the hours spent sifting through boards and formatting resumes. DevFound pairs automation with your personal outreach, so you reserve energy for interviews and negotiation. Traditional networking still matters, but AI gives you a lift before you even send a message.

Modern AI roles expect comfort with production-grade code, data fluency, and practical ML tooling. The strongest candidates pair deep technical chops with storytelling—translating model impact to product, GTM, and exec partners. Continuous learning keeps you ahead as stacks evolve.

DevFound rewards active seekers. Keep your profile fresh, respond to match quality prompts, and enable alerts so you never miss a role. The AI prioritizes companies and teams that align with your feedback, accelerating both introductions and interview invites.

High-density tech hubs continue to host the deepest AI talent pools, yet distributed teams are catching up fast. Use DevFound filters to hone in on onsite, hybrid, or fully remote roles and watch openings expand across time zones.

DevFound aggregates thousands of remote AI openings and flags the nuances—core hours, async culture, and visa needs—up front. The Copilot also recommends how to position your distributed work experience so hiring managers know you can thrive on a remote team.