Explore AI roles

Keyboard friendly • Copy, share & save roles

Sort by

Staff Software Engineer, Machine Learning (LLM Backend) Location: Burlingame, CA (On-site, 4 days/week) Employment Ty...

Fulltime Machine Learning

$145k - $250k · Senior Fully remote

Apply

Senior Infrastructure Software Engineer - Medical AI Platform Location: Hybrid - Miami Compensation: $200,000 – $250,...

Fulltime Ai Machine Learning

$200k - $250k · Senior Fully remote

Apply

Senior Full Stack Engineer (Frontend-Centric) - AI Marketing & Data Platform Location: Remote - US or Canada Compensa...

Fulltime Remote Ai Machine Learning

$180k - $270k · Senior Fully remote

Apply

Senior Software Engineer - AI-Powered Healthcare Communication Location: Hybrid - San franciisco Compensation: $125K ...

Ai Machine Learning Generative Ai Robotics

$125k - $200k · Senior Fully remote

Apply

Senior Data Scientist - Economic Risk & DeFi Simulation Location: Remote - Preference for NYC - Will accept Remote US...

Fulltime Remote Machine Learning Data Science

$130k - $150k · Senior Fully remote

Apply

Selected role

Staff Software Engineer Machine Learning

MLabs San Francisco, CA

Live

$145k - $250k · Senior Full-time Posted 7 days ago 4 min read

Staff Software Engineer, Machine Learning (LLM Backend) Location: Burlingame, CA (On-site, 4 days/week)

Employment Type: Full-time

Salary Range: $145K - $250K

We are a rapidly growing AI technology company transforming mission-critical processes in the healthcare industry . We are seeking a Staff Software Engineer to architect and scale the secure, reliable backend systems that power our advanced Large Language Model (LLM) applications. This role requires expertise at the intersection of applied AI, distributed systems, and security/compliance in a regulated domain.

You will be responsible for pushing LLMs beyond demos into mission-critical, cost-efficient, and secure production healthcare workflows. This is a technical leadership role driving the end-to-end delivery of core ML/LLM systems.

Key Responsibilities:

Backend for LLMs: Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for high-volume healthcare use cases (e.g., automated voice AI agents)
Data & Retrieval Pipelines: Build robust ingestion, preprocessing, and Retrieval-Augmented Generation (RAG) pipelines to ground LLMs in proprietary clinical and revenue-cycle data
LLMOps & Observability: Design and implement systems for model monitoring, evaluation harnesses, cost tracking, and guardrails, ensuring reliability and responsible use in production
Performance & Optimization: Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments
Security & Compliance: Implement HIPAA-ready infrastructure, robust data governance, and auditability for all LLM-powered applications in a regulated setting
Technical Leadership: Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in complex LLM system design

Requirements

Experience: 5+ years of backend or full-stack software engineering experience, with 3+ years working specifically on ML/LLM-enabled applications
Coding Proficiency: Strong coding skills in Python and ideally experience with one statically typed language (e.g., Go, Java, or TypeScript)
LLM Integration: Experience with LLM integration frameworks (e.g., Hugging Face, LangChain, LlamaIndex, or direct APIs from OpenAI/Anthropic)
Cloud-Native Expertise: Deep knowledge of distributed systems, service-oriented architecture, and building APIs at scale. Hands-on experience with cloud platforms (AWS/GCP/Azure), Kubernetes, Docker, and Terraform
System Design & LLMOps: Excellent system design skills and familiarity with MLOps/LLMOps practices (CI/CD for models, evaluation, monitoring)
Location: Must be available to work 4 days a week on-site in the Burlingame office

Preferred Qualifications:

Experience applying LLMs in healthcare or other regulated industries (e.g., familiarity with FHIR, HL7, HIPAA)
Hands-on experience with RAG pipelines, vector databases, and structured-output orchestration
Background in enterprise SaaS or mission-critical platforms where uptime and strict compliance are paramount

Benefits

Highly competitive base salary ($145K - $250K) based on experience and qualifications
Equity Options as part of the total compensation package
Comprehensive Benefits: Health, dental, and vision coverage, and 401(k) plan
Unlimited PTO policy
Visa Sponsorship is available
A leadership role with ownership over core AI systems in a domain that drives significant, real-world impact

Due to the high volume of applications we anticipate, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search. Commitment to Equality and Accessibility: At MLabs, we are committed to offer equal opportunities to all candidates. We ensure no discrimination, accessible job adverts, and providing information in accessible formats. Our goal is to foster a diverse, inclusive workplace with equal opportunities for all. If you need any reasonable adjustments during any part of the hiring process or you would like to see the job-advert in an accessible format please let us know at the earliest opportunity by emailing human-resources@mlabs.city.

MLabs Ltd collects and processes the personal information you provide such as your contact details, work history, resume, and other relevant data for recruitment purposes only. This information is managed securely in accordance with MLabs Ltd's Privacy Policy and Information Security Policy, and in compliance with applicable data protection laws. Your data may be shared only with clients and trusted partners where necessary for recruitment purposes. You may request the deletion of your data or withdraw your consent at any time by contacting legal@mlabs.city.

Ready to apply? You'll go straight to the hiring team.

No agency in the middle · Your profile is shared privately.

Explore the complete AI ecosystem

Discover the best AI-first companies, podcasts, events, learning paths, and jobs in one focused hub.

AI Learning Hub · Always curated, never noisy

Simple pricing for serious AI hiring

Pay per listing. No subscriptions, no hidden fees. Designed for teams hiring for high-impact AI roles.

No-risk: replace or refund if the role doesn’t get traction.

Standard listing

Reach active AI talent

For startups

$349 per role

30-day live listing in the AI job feed.
Structured posting written for AI engineers (we’ll help refine copy).
Instant alerts to subscribed candidates for your tags (LLMs, agents, infra, etc.).

Most teams see first applicants within 24–48 hours.

Max visibility to senior talent

For scale-ups

$649 per role

Everything in Standard, plus homepage & “Featured role” placement.
Priority placement in weekly AI roles newsletter.
1:1 review of your role with DevFound to calibrate for top-tier candidates.
Highlight badge on job page to increase conversion.

Best for teams hiring 1–3 critical AI roles this quarter.

Machine Learning Jobs at MLabs

Explore AI roles

Staff Software Engineer Machine Learning

Senior Infrastructure Software Engineer

Senior Full Stack Engineer

Senior Software Engineer

Senior Data Scientist

Explore the complete AI ecosystem

Choose Your Plan

Simple pricing for serious AI hiring

Reach active AI talent

Max visibility to senior talent