Skip to main content
Nuance Labs logo

Member of Technical Staff — Model Optimization and Inference (New Grad)

Nuance Labs

Seattle, WAFull-time$200–300K/yrPosted 5mo agoStill listed 6 days ago

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$200–300K/yr
Location
Seattle, WA
Schedule
Full-time
Work Authorization
Open to visa holders • Sponsors visas

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Nuance Labs is seeking an early-career engineer to optimize inference for its real-time, full-duplex multimodal AI system. The role focuses on reducing latency across language, audio, and diffusion models through serving improvements, KV cache strategies, profiling, quantization, and kernel acceleration. Candidates may be finishing or have recently completed a BS, MS, or PhD; the company emphasizes systems intuition, engineering ability, and willingness to learn.

Skills & qualifications

RequiredNice to have

Skills

LLM Inference, requiredML Systems, requiredKV Caching, requiredMemory Layout, requiredAttention Kernels, requiredBatching, requiredInference Serving, requiredvLLM, requiredSGLang, requiredTensorRT-LLM, requiredPython, requiredPyTorch, requiredCUDA, nice to haveTriton, nice to haveProfiling, requiredOptimization, requiredDiffusion Inference, nice to haveSpeculative Decoding, nice to haveQuantization, nice to haveModel Compression, nice to haveMultimodal Inference, nice to haveStreaming Inference, nice to haveReal-Time Systems, nice to have

Qualifications

BS, MS, or PhD in CS, ML, or Related Field, required

Benefits

Medical Insurance
Paid Time Off
401(k) Match

Full job description

About Nuance Labs

Nuance Labs is building photorealistic, real-time AI avatars with emotional intelligence: a full-duplex audiovisual system that can listen, speak, react, interrupt, and respond like a real person.

We're a research company, with PhDs from MIT, UW, Oxford, CMU, and Johns Hopkins, and industry experience from Apple, Meta, Amazon AGI, and more. Backed by Accel, Lightspeed, South Park Commons, and NVIDIA, we combine frontier research with ruthless engineering needed for consumer-grade, real-time systems. The team is small, the work is real, and the problems are unsolved.

How Nuance Differentiates

Most conversational AI avatars today are hacks — a face slapped on a speech-to-speech pipeline, stuck in the uncanny valley: emotionless, mechanical, one-turn-at-a-time. Current systems take 2–5 seconds to respond; natural conversation requires sub-500ms. That's a 10x improvement, and it demands rethinking the entire stack.

That rethinking starts with full-duplex: an AI that listens and speaks simultaneously, perceives emotion in real time, and responds with a face that actually reflects it. It's an extremely hard problem, and we're developing foundation models designed for it from the ground up.

About the Role

We can train a great model. The next problem is making it fast enough to actually use in a real-time conversation — and that gap is enormous. A model that responds in 3 seconds is a demo. A model that responds in under 500ms is a product.

We’re looking for someone who’s excited about taking trained models and squeezing every last millisecond out of them. You understand — or want to deeply understand — the full stack from model weights to serving infrastructure: quantization, KV cache optimization, kernel-level acceleration, batching strategies. You’ve worked with vLLM, SGLang, or similar frameworks (through coursework, research, internships, or open-source) and have opinions about where they fall short.

This posting is aimed at early-career engineers finishing or recently finished with a BS, MS, or PhD. We don’t require a PhD — we care about systems intuition, engineering chops, and the appetite to go deep.

Our stack is more complex than a standard LLM deployment: we’re serving a full-duplex multimodal system that must satisfy strict real-time latency constraints. There’s a lot of unsolved optimization work here, and we want someone who finds that genuinely exciting and is ready to grow fast alongside people who’ve built these systems before.

What You’ll Do

  • Contribute to end-to-end inference optimization across our model stack — LLMs, audio models, and diffusion-based components

  • Implement and tune KV cache strategies for long-context conversations, including eviction policies, compression, and memory-efficient attention

  • Work with inference serving frameworks (vLLM, SGLang, TensorRT-LLM, etc.) and extend them for our specific workloads

  • Profile and benchmark end-to-end latency and throughput; identify and systematically eliminate bottlenecks

  • Build internal tooling that makes optimization work faster and more rigorous — profiling viewers, end-to-end inference test harnesses, and other infrastructure that helps the team move quickly

  • Accelerate diffusion model inference — consistency models, step distillation, caching strategies, and custom kernel optimizations

  • Apply quantization techniques (INT8, INT4, GPTQ, AWQ, and beyond) to reduce memory footprint and increase throughput without meaningfully degrading quality

  • Work closely with research and infrastructure to ensure new models ship with optimized serving from day one

What We’re Looking For

  • BS, MS, or PhD in CS, ML, or a related field — completed or in the final stretch

  • Strong fundamentals in LLM inference or ML systems — KV caching, memory layout, attention kernels, batching, or serving — picked up through coursework, research, internships, or open-source. You don’t need to have shipped at production scale yet; you do need to learn fast and go deep.

  • Exposure to inference serving frameworks (vLLM, SGLang, TensorRT-LLM, or similar) — even at a research or hobby level

  • Strong Python and PyTorch skills; familiarity with CUDA or Triton is a significant plus

  • A systematic approach to profiling and optimization — you measure first, then optimize

  • Curiosity about diffusion inference, speculative decoding, quantization, or other inference-time acceleration techniques

Bonus Points

  • Internship or research experience with LLM inference, ML systems, or model serving

  • Contributions to open-source inference frameworks (vLLM, SGLang, TensorRT-LLM, etc.)

  • CUDA / Triton kernel work, even at a research or hobby scale

  • Publications or research projects in MLSys, model compression, or inference optimization

  • Familiarity with multimodal or streaming inference architectures

  • Experience with hard latency SLAs in any real-time system

Compensation

$200,000 – $300,000 base salary, plus meaningful equity. We think long-term ownership matters and structure equity accordingly.

Logistics

  • Location: In-person in Seattle, five days a week — we believe in the compounding value of working shoulder-to-shoulder.

  • Visa sponsorship: We sponsor visas (O-1, H-1B, green card, etc.) from day one.

  • AI-native tooling: Do your best work with the best tools, including unlimited tokens.

Benefits & perks

  • Health: We offer a variety of plans that meet your needs, including an HDHP with ~$2,000 in annual HSA contributions by the company (roughly 2x what most big tech companies put in).

  • Wellness: $2,000/yr to spend on gym memberships, fitness equipment, training/coaching, classes, and more.

  • Work setup: One-time $500 to spend on any tech or accessories that you might need to optimize your workflow.

  • Time off: 15 days of PTO, 10 public holidays, and we close the office for a full week at year-end.

  • Food: Lunch, drinks, and snacks on us every workday. We observe boba tea Tuesdays and Thursdays.

  • Commuter benefits: Utilize pre-tax money (up to $340/month) for parking and transportation.

  • 401(k): 4% match (100% of 1st 3% + 50% of next 2% contributions).

Nuance Labs is an equal opportunity employer. We believe diverse teams build better AI.

How this job compares

Set against the 6,360 open Machine Learning Engineer jobs on Olive Jobs, counted November 16, 2026.

Pay
  • This posting$200–300K/yr
  • Washington median$156–241K/yr313 salary ranges
  • US median$144–245K/yr5,429 salary ranges

This range's midpoint, $250K, is 27% above the Washington median midpoint ($197K) — in the top quarter of Machine Learning Engineer salary ranges in Washington.

Openings
Olive Jobs lists 379 open Machine Learning Engineer jobs in Washington and 6,360 across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most in Washington
Experience
Machine Learning Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 3 to 7 years (5,294 postings).
Education
2,204 of the 6,360 open Machine Learning Engineer jobs (35%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 16, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.