Role overview
Direct message the job poster from Berkley Hunt
Haseena Sophia Mooncey
Haseena Sophia Mooncey
Berkley Hunt has partnered with a fast-growing seed-stage AI infrastructure company that is building developer tooling for large language models. Having already surpassed $7M+ ARR, the company is rapidly scaling as more organizations adopt AI into production systems.
Their platform enables developers to interact with multiple AI model providers through a unified interface, simplifying how teams build, deploy, and manage AI-powered applications. As the AI ecosystem continues to evolve quickly, the team is focused on solving challenges around standardizing model access, improving performance, and delivering reliable infrastructure for AI workloads. To support this growth, they are seeking a Backend LLM Engineer to help design and build the core systems that power the platform.
About the Role:
As a Backend LLM Engineer, you will work closely with the founding team to build and scale infrastructure that simplifies how developers interact with multiple AI model providers.
You will have ownership over developing unified APIs, implementing provider integrations, and ensuring high-performance backend systems capable of handling large volumes of requests.
This role requires strong backend engineering fundamentals, experience building production APIs, and an interest in the rapidly evolving ecosystem of AI platforms and developer infrastructure.
What you'll work on
Design and maintain backend APIs that standardize interactions with multiple AI model providers
Build and maintain integrations that translate requests between unified APIs and provider-specific formats
Ensure consistent functionality across different AI model endpoints and capabilities
Handle provider-specific differences such as parameter compatibility, streaming behaviour, and request formatting
Implement support for new model capabilities and platform features as they are released
Develop systems for logging, monitoring, and usage tracking across model providers
Optimize backend services for performance, reliability, and scalability
Collaborate closely with the founding team on infrastructure that directly impacts the developer experience
Expectations:
Professional experience working on backend or full-stack production systems
Strong proficiency in Python and backend API development
Experience working with external APIs and distributed systems
Familiarity with large language model APIs or AI platform integrations
Interest in developer infrastructure, AI platforms, and modern backend architectures
Ability to work effectively in a small, fast-moving startup environment
Strong problem-solving skills and a proactive approach to building production-ready systems
Show more
Show less
Seniority level
Not Applicable
Employment type
Contract
Job function
Information Technology
Industries
IT Services and IT Consulting