Machine Learning Engineer
Bengaluru, Karnataka, IndiaJobNo compensation foundPosted 3mo agoVerified open 3 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Don't just apply. Show up ready.
Olive works from this exact posting — no sign-up to start.
At a glance
Compensation
No compensation found
Location
Bengaluru, Karnataka, India
Work Authorization
Not specified
Job overview
The role focuses on building and scaling production AI systems that handle high concurrency, integrating multiple LLM models, and optimizing inference performance to directly impact customer subscription retention.
Skills & qualifications
RequiredNice to have
Skills
Artificial IntelligenceRESTCommunication ProtocolsContent Distribution NetworksTensorFlowDatabase CachingMachine LearningRedisAsync/Event-Driven ArchitecturesContent Delivery NetworkMessage QueuesReal-Time Communication ProtocolsLarge Language ModelsTensorFlow ServingTritonAI Model ServingBatchingModel QuantisationConversation State Management
Qualifications
3-5 Years Production Systems Experience
Full job description
Requirements:
- 3-5 years building production systems handling > 10k concurrent users.
- Proven experience with async/event-driven architectures (not just REST APIs).
- Hands-on experience scaling ML/AI inference in production.
- Deep understanding of caching strategies (Redis, in-memory, CDN).
- Experience with message queues and real-time communication protocols.
AI-Specific Expertise:
- Built systems integrating multiple LLM/AI models in production.
- Experience with AI model serving frameworks (TensorFlow Serving, Triton, etc. )
- Understanding of AI inference optimisation (batching, caching, model quantisation).
- Knowledge of conversation state management and context handling.
- Has debugged production issues under high AI inference load.
Growth Path:
- Direct impact on customer subscription retention through performance.
- Exposure to cutting-edge AI infrastructure challenges.
- Ownership of technical decisions affecting revenue-generating conversations.
You've read the whole posting — now see how you match it.