LUMA AI

Architect end-to-end model serving pipelines and integrate new model architectures from our research team into our core, high-throughput inference engine.
Build robust and sophisticated scheduling systems to manage jobs based on cluster availability and user priority, ensuring we optimally leverage thousands of expensive GPU resources.
Design and implement dynamic, traffic-based systems for hotswapping models on our GPU workers to maximize fleet efficiency and meet product SLOs.
Own the en...