Fleet AI logo

Member of Technical Staff, Research Engineer, Infrastructure

Fleet AI

San Francisco, CAJob$200–600K/yrPosted todayStill listed today

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$200–600K/yr
Location
San Francisco, CA
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

Fleet AI is hiring its first Research Engineer for Infrastructure to own the infrastructure supporting its research, including the training and inference stacks, research codebase, GPU cluster, and kernels. The role works closely with researchers to identify and fix performance and reliability bottlenecks. The position is on-site in San Francisco, with a stated annual salary range of $200,000–$600,000 plus equity.

Skills & qualifications

RequiredNice to have

Skills

Networking TechnologiesOpen Source SoftwarePyTorchCUDAGPUResearchNodeMachine LearningFault Tolerant SystemsFailure AnalysisInfrastructureDistributed TrainingMulti-Node TrainingData ParallelismTensor ParallelismPipeline ParallelismFSDPPerformance ProfilingTritonFused KernelsAttention VariantsInference SystemsvLLMSGLangKV CacheContinuous BatchingSpeculative DecodingQuantizationResearch Codebase RefactoringPPOGRPORLHFTraining Failure TriageMegatronDeepSpeedNCCLFlash-AttentionGPU Fleet OperationsRoCEInfiniBandGPUDirectRL Rollout SystemsAsync TrainingOff-Policy Training Infrastructure

Qualifications

Multi-Node Training ExperienceHundreds of GPUsShipped Fused Op or Attention VariantProduction Inference Stack ExperienceResearch Repository Improvement

Full job description

About Fleet

Fleet studies how environments produce intelligence. We believe intelligence is an emergent property of environmental pressures: the environment determines what capabilities develop, what behaviors survive, and what "good" looks like. We work with frontier labs on post-training across modalities, building benchmarks that expose where frontier models break, training recipes that close those gaps, and scalable oversight for long-horizon agents. Backed by Sequoia Capital, Menlo Ventures, BCV, and SV Angel.

About the Role

Fleet runs a large GPU cluster. As a Research Engineer, you own the infrastructure our research runs on: the training stack, the inference stack, the research codebase that ties them together, the cluster itself, and the kernels at the bottom. Your job is to keep all of it fast and reliable as the research moves.

You work close to the researchers and fix what is actually slow, where the fix belongs. Sometimes that is a Triton kernel. Sometimes it is a parallelism config change. Sometimes it is deleting a library nobody is using anymore.

The research codebase is under active development and most of the bottlenecks are not obvious from outside it. We want someone who can profile a stalled collective, write a fused kernel, and refactor research code without breaking the science. This is hire #1 for the role.

What You'll Do

  • Own the cluster. Capacity, failover, fault tolerance, and on-call when training stalls.

  • Drive utilization. Profile training runs, find the bottleneck (NCCL, KV cache, dataloader, allgather), and fix it. Write kernels when the profiler points there.

  • Maintain training and inference. Distributed training (FSDP, TP, PP), rollout generation, async training, and the inference stack the training loop depends on.

  • Maintain the research codebase. Keep it fast and reliable as researchers extend it. Refactor without breaking the science.

How We Work

  • Small, technical team.

  • Speed with rigor.

  • Truth over comfort.

  • On-site in SF.

What We're Looking For

  • Distributed training depth. Hands-on experience with multi-node training (tens of GPUs at minimum, ideally hundreds) and the major parallelism strategies (DP, TP, PP, FSDP).

  • Performance and kernels. You can profile a slow training run and land the fix. You write CUDA and Triton, and have shipped a fused op or attention variant in a real training run.

  • Inference systems. You have built or maintained a high-throughput inference stack (vLLM, SGLang). KV cache, continuous batching, speculative decoding, and quantization are tools you have used in production.

  • Research-codebase taste. You have walked into a sprawling, half-documented research repo and made it measurably faster or more reliable without breaking the science. RL post-training methods (PPO, GRPO, RLHF) and their failure modes are familiar enough that you can triage a training failure from a log line.

Especially Exciting

  • Contributions to PyTorch, vLLM, SGLang, Megatron, DeepSpeed, FSDP, NCCL, flash-attention, or other open-source ML systems.

  • Experience operating GPU fleets at scale.

  • Experience with RoCE / InfiniBand, GPUDirect, or similar high-performance networking.

  • Prior work on RL rollout systems, async training, or off-policy training infra.

Compensation

On-site in San Francisco.

Salary range: $200,000–$600,000 USD annually, plus meaningful equity.

How this job compares

Set against the 1,156 open Research Engineer jobs on Olive Jobs, counted October 29, 2026.

Pay
  • This posting$200–600K/yr
  • California median$184–341K/yr392 salary ranges
  • US median$148–257K/yr834 salary ranges

This range's midpoint, $400K, is 58% above the California median midpoint ($254K) — in the top quarter of Research Engineer salary ranges in California.

Openings
Olive Jobs lists 570 open Research Engineer jobs in California and 1,156 across the US. 5% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
Research Engineer postings that state a minimum ask for 3 years of experience at the median; the middle half ask for 2 to 5 years (661 postings).
Education
435 of the 1,156 open Research Engineer jobs (38%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on October 29, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.