AI / ML Data Scientist
Bangalore, Karnataka, IndiaJobNo compensation foundPosted 4mo agoVerified open 3 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Don't just apply. Show up ready.
Olive works from this exact posting — no sign-up to start.
At a glance
Compensation
No compensation found
Location
Bangalore, Karnataka, India
Work Authorization
Not specified
Job overview
The role seeks a professional with at least three years of experience building production systems that serve over ten thousand concurrent users, focusing on scaling AI/ML inference, async architectures, and advanced caching strategies.
Skills & qualifications
RequiredNice to have
Skills
RedisRESTMachine LearningTensorFlowCommunication ProtocolsDatabase CachingArtificial IntelligenceContent Distribution NetworksAsync/Event-Driven ArchitecturesProduction ML/AI Inference ScalingIn-Memory CachingContent Delivery NetworksMessage QueuesReal-Time Communication ProtocolsLLM/AI Model IntegrationTensorFlow ServingTriton Inference ServerAI Inference OptimisationBatchingModel QuantisationConversation State ManagementContext Handling
Qualifications
3+ Years Building Production Systems
Full job description
Requirements:
- Must-have experience: 3+ years building production systems handling > 10k concurrent users.
- Proven experience with async/event-driven architectures (not just REST APIs).
- Hands-on experience scaling ML/AI inference in production.
- Deep understanding of caching strategies (Redis, in-memory, CDN).
- Experience with message queues and real-time communication protocols.
- AI-Specific expertise: Built systems integrating multiple LLM/AI models in production.
- Experience with AI serving frameworks (TensorFlow Serving, Triton, etc. )
- Understanding of AI inference optimisation (batching, caching, model quantisation).
- Knowledge of conversation state management and context handling.
- Has debugged production issues under high AI inference load.
You've read the whole posting — now see how you match it.