LLM Operations Engineer

About the Role

Run and optimize LLM infrastructure, serving, and operational workflows.

Responsibilities

• •Own key deliverables for the engineering team in Mumbai.
• •Collaborate with cross-functional stakeholders to ship high-quality outcomes.
• •Contribute to process improvements, documentation, and team best practices.
• •Support hiring, mentoring, or customer-facing activities as needed for the role.

Requirements

• •Experience operating LLM or ML inference systems
• •Understanding of latency, cost, and quality trade-offs
• •Familiarity with observability for AI systems

Skills