Cloud Inference Engineer
San Francisco, CAFull-timeSeen 2mo agoStill listed 2 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
You apply on the employer's site, with no Olive account needed.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Luminal seeks a Cloud Inference Engineer to join the founding team onsite in downtown San Francisco. The role focuses on deploying, tuning, and optimizing low‑latency, high‑throughput model serving on Luminal Cloud, including performance reviews, scheduler improvements, and occasional kernel development.
Skills & qualifications
Skills
Full job description
Qualifications
- CUDA + GPU inference optimization
- vLLM, SGLang, or TensorRT-LLM experience
- KV caching, paged attention, batching, token streaming, etc.
- Distributed compute (with GPUs is a super plus)
- No degree required
Company Luminal (YC S25) builds an AI compiler and serving stack that makes models 10x faster and production ready with one line. Role Founding, on site in downtown SF. Ship low latency, high throughput model serving on Luminal Cloud. Day to day responsibilities:
- Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc.
- Conducting model performance reviews
- Improve scheduler, batcher, autoscaling; profile latency, cost, utilization
- Sometimes write kernels and, yes, occasional tasteful shitposting
Prepare for this role
You've read the whole posting — now see how you match it.
