Skip to main content
Liquid AI logo

Member of Technical Staff - GPU Inference Engineer

Liquid AI

San Francisco, CA · HybridFull-timePosted todayStill listed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
San Francisco, CAHybrid
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Liquid AI is hiring a GPU Inference Engineer to improve the serving stack used for model evaluation, synthetic data generation, and API serving. The role focuses on profiling and benchmarking inference workloads, tuning serving frameworks, and integrating Liquid Foundation Models into public frameworks and libraries. The engineer will work closely with researchers and serving engineers to identify bottlenecks and deliver measured improvements in speed and cost.

Skills & qualifications

RequiredNice to have

Skills

GPU LLM Inference, requiredvLLM, requiredSGLang, requiredTransformer Forward Pass, requiredAutoregressive Decoding, requiredGPU Fundamentals, requiredInference Profiling, requiredBenchmarking, requiredPython, requiredPyTorch, requiredOpen-Source Codebases, requiredFlashInfer, nice to haveCUDA, nice to haveTriton, nice to haveBatch Inference, nice to have

Qualifications

Hands-on GPU Inference Experience, required

Benefits

Paid Time Off
Medical Insurance
Parental Leave

Full job description

Role: Member of Technical Staff - GPU Inference Engineer Team: Research & Engineering Location: San Francisco; Boston; Remote Location Type: Hybrid Employment Type: Full-time

About Liquid AI Spun out of MIT CSAIL, we build general-purpose AI systems that run efficiently across deployment targets, from data center accelerators to on-device hardware, ensuring low latency, minimal memory usage, privacy, and reliability. We partner with enterprises across consumer electronics, automotive, life sciences, and financial services. We are scaling rapidly and need exceptional people to help us get there.

The Opportunity GPU inference sits underneath much of how we build and ship models at Liquid. Evaluation runs, synthetic data generation, and our API service all depend on how fast and how cheaply we can serve Liquid Foundation Models on GPUs, and demand for that work is growing. You will join the small team that owns our GPU serving stack, built on vLLM and SGLang, and make it faster and cheaper to run.

This is a high-ownership role: you will be pointed at whichever inference bottleneck matters most and carry it from profiling to a benchmarked result. The work sits at the serving-framework level rather than in custom CUDA kernels, which is a separate role on the team.

What We're Looking For We need someone who:

  • Reasons from first principles: Explains why a workload is slow before changing it, working from what the model and the GPU are actually doing rather than from framework defaults.

  • Picks up the next problem and owns it: Moves from evaluation throughput to data generation to API serving as priorities shift, and takes each one through to a measured result.

  • Makes other teams faster: Works directly with the researchers and engineers who depend on inference, and treats their throughput as the result that counts.

The Work

  • Own and improve our GPU serving stack on vLLM and SGLang, from configuration and scheduling choices to changes in the frameworks themselves

  • Speed up large-scale evaluation and synthetic data generation, and design the inference pipelines those workloads run on

  • Select, profile, and benchmark the inference engine behind our API service, and adapt the API layer around it

  • Integrate Liquid Foundation Models into vLLM, SGLang, and Hugging Face Transformers, and maintain those public integrations as models and frameworks change

  • Diagnose throughput and latency problems alongside the researchers and serving engineers who hit them

Experience & Capabilities What you'll need:

  • Hands-on experience running LLM inference on GPUs with a serving framework such as vLLM or SGLang, beyond default configuration

  • First-principles understanding of LLM inference: the transformer forward pass, autoregressive decoding on a GPU, and the latency, throughput, and memory trade-offs that follow

  • Solid grasp of GPU fundamentals as they bear on inference. You do not need to have written CUDA kernels

  • Experience profiling and benchmarking inference workloads and acting on what the numbers show

  • Strong Python and PyTorch, and comfort reading and changing large open-source codebases

Helpful, not required:

  • Merged contributions to vLLM, SGLang, or FlashInfer

  • Lower-level GPU optimization experience, such as CUDA or Triton kernels

  • Experience building high-throughput batch inference for evaluation or synthetic data generation

What Success Looks Like (Year One)

  • Evaluation and synthetic data generation run measurably faster and at lower cost per token on the same hardware, freeing GPU capacity for other work

  • The inference engine and configuration behind our API service are chosen on benchmark evidence, and have been profiled and tuned for latency and throughput

  • Liquid models run correctly and efficiently in the public serving frameworks and libraries our users rely on, including vLLM, SGLang, and Transformers

What We Offer

  • Problems standard stacks don't solve: Our hybrid architectures do not drop into off-the-shelf serving frameworks unchanged, and the inference you speed up feeds how every Liquid model is evaluated and trained. High ownership from day one. [INFERRED -- review this line]

  • Compensation & Equity: Competitive base salary plus equity, so you share in what we build. Final offers reflect skills, experience, and location.

  • Time Off: Unlimited PTO, plus company-wide Refill Days, long weekends when the whole company rests together.

  • Health & Wellbeing: Comprehensive health coverage, with details varying by location.

  • Paid Leave: Paid leave for pregnancy, parenting, medical needs, and caring for family.

How this job compares

Set against the 6,238 open Machine Learning Engineer jobs on Olive Jobs, counted November 20, 2026.

Pay
  • This postingNot listed
  • California median$175–262K/yr1,391 salary ranges
  • California median$50–70/hr27 hourly ranges
Openings
Olive Jobs lists 1,819 open Machine Learning Engineer jobs in California and 6,238 across the US. 9% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
Machine Learning Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 3 to 7 years (5,105 postings).
Education
2,122 of the 6,238 open Machine Learning Engineer jobs (34%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 20, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.