Explore AI roles

Keyboard friendly • Copy, share & save roles

Sort by

We are hiring a talented Senior DevOps Engineer to develop the software and processes for orchestration of AI workl...

Engineer Devops Senior Blockchain

$160k - $230k · Senior Fully remote

Apply

As a Senior Cloud Engineer, you will be responsible for building the next generation, highly available, global, mul...

Cloud Dev Senior Aws

$160k - $230k · Senior Fully remote

Apply

Selected role

Senior DevOps Engineer

Together AI Remote

Live

$160k - $230k · Senior Full-time Posted almost 2 years ago 3 min read

We are hiring a talented Senior DevOps Engineer to develop the software and processes for orchestration of AI workloads over large fleets of distributed GPU hardware. In this role, you'll be part of a cloud engineering organization that aims to automate everything and build failure-resistant and horizontally scalable cloud infrastructure for GPU-resident applications.

As a Senior DevOps Engineer, you'll build deep understanding of Together AI’s services and use that knowledge to optimize and evolve our infrastructure's reliability, availability, serviceability, and profitability.

The best applicants for this role are deeply technical, enthusiastic, great collaborators, and intrinsically motivated to deliver high quality infrastructure. You have experience practicing infrastructure-as-code, including the use of tools like Terraform and Ansible. You also have strong software development fundamentals, systems knowledge, troubleshooting abilities, and a deep sense of responsibility.

Requirements

Minimum of 5 years of prior relevant experience in DevOps, cloud computing, data center operations, SRE, and Linux systems administration
Experience in programming in at least one of the following languages: Java, Python, Go, C++
Experience designing and building advanced CI/CD pipeline frameworks
Experience with cloud computing toolsets like Terraform, Vault, and Packer
Experience with configuration management tools like Ansible, Pulumi, Chef and Puppet
Experience with Kubernetes, containerization and VPNs
Strong sense of ownership and desire to build great tools for others
Self-driven and motivated, with a strong work ethic and a passion for problem solving
Experience with AI workloads and blockchain based protocols a plus
GPU programming, NCCL, CUDA knowledge a plus
Experience with Pytorch or Tensorflow a plus

Responsibilities

Create a highly automated infrastructure pipeline for deploying and scaling distributed and multi-tenant GPU-resident compute to new cloud and data center environments
Create infrastructure to auto-scale AI models, create training clusters, and wrestle with CUDA dependencies
Introduce tools to facilitate greater automation and operability of services
Design, build, and maintain CI/CD infrastructure
Architect, deploy, and scale observability infrastructure
Participate in on-call rotation and ensure uptime of services
Investigate production issues and help prevent their reoccurrence
Create runtime tools/processes that optimize cloud triaging and limit downtime
Define best practices to make our systems and services measurable
Work closely with internal teams to ensure best practices are appropriately applied
Build tools to help engineering and research teams measure and improve their velocity
Analyze and decompose complex software systems
Collaborate with and influence others to improve the overall design

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $160,000 - $230,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

Ready to apply? You'll go straight to the hiring team.

No agency in the middle · Your profile is shared privately.

Explore the complete AI ecosystem

Discover the best AI-first companies, podcasts, events, learning paths, and jobs in one focused hub.

AI Learning Hub · Always curated, never noisy

Simple pricing for serious AI hiring

Pay per listing. No subscriptions, no hidden fees. Designed for teams hiring for high-impact AI roles.

No-risk: replace or refund if the role doesn’t get traction.

Standard listing

Reach active AI talent

For startups

$349 per role

30-day live listing in the AI job feed.
Structured posting written for AI engineers (we’ll help refine copy).
Instant alerts to subscribed candidates for your tags (LLMs, agents, infra, etc.).

Most teams see first applicants within 24–48 hours.

Max visibility to senior talent

For scale-ups

$649 per role

Everything in Standard, plus homepage & “Featured role” placement.
Priority placement in weekly AI roles newsletter.
1:1 review of your role with DevFound to calibrate for top-tier candidates.
Highlight badge on job page to increase conversion.

Best for teams hiring 1–3 critical AI roles this quarter.

Together AI Jobs

Explore AI roles

Senior DevOps Engineer

Senior Cloud Engineer

Explore the complete AI ecosystem

Choose Your Plan

Simple pricing for serious AI hiring

Reach active AI talent

Max visibility to senior talent