Role overview
We are looking for a
Generative AI Platform Engineer
to design, build, and scale enterprise-grade AI platforms and APIs that enable the adoption of large language models and generative AI capabilities across the organization. This role is focused on platform engineering, not just model experimentation — you will be responsible for building robust, secure, and highly scalable systems that integrate with leading cloud-based AI services. You will work closely with software engineers, data scientists, and product teams to deliver reusable AI infrastructure, developer-friendly APIs, and production-ready solutions.
What you'll work on
- Design and build scalable Generative AI platforms, services, and APIs for internal and external consumers
- Develop and maintain high-performance backend services using Python and one or more of C++, C#, or Java
- Integrate and operationalize LLM and foundation model APIs, including: Azure OpenAI Google Vertex AI AWS Bedrock
- Build abstraction layers and orchestration logic to support multiple model providers and deployments
- Design RESTful and/or gRPC APIs with a strong focus on reliability, security, and performance
- Implement platform capabilities such as:
- Prompt management and versioning Model routing and fallback strategies.
- Observability, logging, and monitoring Cost and usage tracking
- Deploy and operate services on Google Cloud Platform (GCP), leveraging managed services where appropriate Support CI/CD, infrastructure-as-code, and production operations
- Contribute to platform architecture decisions and engineering best practices
What we're looking for
- Experience designing multi-tenant or enterprise AI platforms
- Familiarity with MLOps or LLMOps concepts (model lifecycle, monitoring, evaluation)
- Experience with containerization and orchestration (Docker, Kubernetes)
- Knowledge of authentication, authorization, and secure API design
- Experience supporting developer platforms or internal tooling
Tags & focus areas
Used for matching and alerts on DevFound Fulltime Remote Ai Data Science Generative Ai