Olive Jobs
Oolka logo

Senior AI Engineer

Oolka

Bangalore, Karnataka, IndiaJobNo compensation foundPosted 1mo agoVerified open 2 days ago
Evaluate my fit

Most applications go out cold — see where you stand first. No sign-up to start.

Don't just apply. Show up ready.

Olive works from this exact posting — no sign-up to start.

Evaluate your fitSee where you stand — strengths, gaps, and what to fix first.Get started →Tailor your résuméRewritten against this posting, with a diff of every change.Get started →Practice the interviewA voice mock interview built from this job description.Get started →

At a glance

Compensation
No compensation found
Location
Bangalore, Karnataka, India
Work Authorization
Not specified

Job overview

The Senior AI Engineer will design and build scalable backend services for AI applications, integrate large language models, and create agentic AI workflows while ensuring high‑concurrency, low‑latency performance on cloud infrastructure.

Skills & qualifications

RequiredNice to have

Skills

SOA/MicroservicesApache KafkaDatabase CachingDjangoObservabilityGrafanaAmazon Web ServicesRabbitMQAgent SystemsLow LatencyArtificial IntelligencePythonConcurrency DesignFastAPIRedisDatadogPrometheusFinancial TechnologyDockerWebSocketsKubernetesKafkaSSEAWSLangGraphLangChainMulti-Agent SystemsLLM IntegrationAsync Architecture

Qualifications

3-5 Years Backend Engineering Experience

Full job description

Responsibilities:

  • Building scalable backend services for AI applications.
  • Integrating LLMs like OpenAI, Claude, Gemini, Bedrock, or vLLM into production.
  • Building agentic AI workflows using LangGraph, LangChain, or similar frameworks.
  • Designing asynchronous, event-driven systems using Kafka, RabbitMQ, WebSockets, or SSE.
  • Handling retries, rate limiting, circuit breakers, and provider fallback when AI services fail.
  • Optimising AI performance using Redis caching and low-latency architectures.
  • Building microservices that support high-concurrency production traffic (10,000+ concurrent users).
  • Deploying and monitoring applications on AWS with Kubernetes, Docker, and observability tools like Grafana or Prometheus.

Requirements:

  • 3-5 years of backend engineering experience.
  • Proficiency in Python (FastAPI/Django).
  • Knowledge of Production LLM integration (OpenAI, Claude, Gemini, Bedrock, vLLM, etc. ).
  • Proficiency in Agentic AI (LangGraph, LangChain, Multi-Agent Systems).
  • Advanced Async/event-driven architecture (Kafka, RabbitMQ, SQS, WebSockets, SSE).
  • Proficiency in Redis caching and microservices.
  • High-concurrency, low-latency systems.

Good to Have:

  • Kubernetes, Docker, AWS.
  • Observability (Grafana, Datadog, Prometheus).
  • Fintech or payments experience.
  • Startup experience.
  • Experience breaking monoliths into microservices.

You've read the whole posting — now see how you match it.

Evaluate my fit