Member of Technical Staff - Infrastructure
San Francisco, CAFull-timePosted 5mo agoStill listed · checked in the last 2 days
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Job overview
Gimlet Labs seeks an Infrastructure Platform Engineer to build systems that transform heterogeneous accelerator hardware into reliable production infrastructure for its AI neocloud. The role involves deploying and operating clusters, automating hardware provisioning, enhancing scheduling and observability, and collaborating across distributed systems, runtime, compiler, networking, and hardware teams.
Skills & qualifications
Skills
Qualifications
Full job description
About us Gimlet is building the first multi-silicon neocloud designed for fast, efficient AI inference. We combine large-scale compute infrastructure with an execution platform that partitions AI workloads and maps each stage to the hardware best suited to run it. We work with foundation labs, hyperscalers, and AI-native companies, giving our team access to technical problems spanning frontier models, production infrastructure, and emerging hardware. About the role As an Infrastructure Platform Engineer, you will build the systems that turn heterogeneous accelerator hardware into reliable production infrastructure for Gimlet's AI cloud. Gimlet's fleet spans hardware with different architectures, software stacks, operational characteristics, and failure modes. Your work will determine how new hardware is brought online, how clusters are provisioned and operated, and how production inference systems remain reliable as the fleet scales. You will work across bare metal, Linux, Kubernetes, cluster scheduling, observability, and automation. You will build systems that abstract differences between accelerator architectures, make new hardware production-ready, and improve the reliability and operability of Gimlet’s infrastructure. What success looks like In your first 12–18 months, you will:
-
Deploy and operate production clusters across different accelerator architectures
-
Automate hardware provisioning, validation, upgrades, and fleet lifecycle management
-
Improve cluster scheduling, resource utilization, isolation, and capacity management
-
Build observable infrastructure that enables faster debugging, incident response, and recovery
-
Partner across distributed systems, runtime, compiler, networking, and hardware teams to bring new accelerators into production
You may be a good fit if you have
-
Experience in infrastructure, cluster engineering, platform engineering, SRE, or HPC
-
Strong Linux systems knowledge and production debugging experience
-
Experience operating Kubernetes, Slurm, Nomad, or similar orchestration systems
-
Experience automating infrastructure with Python, Go, Terraform, Ansible, or similar tools
-
Experience with GPU or accelerator infrastructure, including drivers, firmware, or CUDA/ROCm
-
The ability to build systems that are observable, recoverable, and reliable in production
-
A bachelor’s degree in a relevant field or equivalent practical experience
Strong candidates may also have
-
Experience building or operating AI inference, training, HPC, or neocloud infrastructure
-
Experience with bare-metal provisioning, PXE/iPXE, image pipelines, BIOS/firmware management, or rack bring-up
-
Experience with multi-tenant cluster isolation, quota systems, fair scheduling, or usage accounting
-
Experience debugging distributed workload performance across compute, memory, network, and storage bottlenecks
-
Experience building observability platforms using technologies such as Prometheus, OpenTelemetry, Grafana, or similar tooling
-
Familiarity with heterogeneous hardware environments across NVIDIA, AMD, Intel, ARM, or emerging accelerators
Why join now? Gimlet is expanding from its core technology into a production neocloud spanning new hardware, customers, and data centers.
-
Solve hard problems.
-
Own meaningful work.
-
Build for production.
-
Help define what’s next.
Agency Policy: Gimlet Labs does not accept unsolicited resumes from recruitment agencies or search firms. Any unsolicited resumes submitted without a signed agreement will be considered the property of Gimlet Labs, and no fees will be paid.
How this job compares
Set against the 2,231 open Site Reliability Engineer jobs on Olive Jobs, counted November 17, 2026.
- Pay
- This postingNot listed
- California median$165–245K/yr315 salary ranges
- US median$60–69/hr23 hourly ranges
- Openings
- Olive Jobs lists 402 open Site Reliability Engineer jobs in California and 2,231 across the US. 19% of them nationwide are listed as remote or flexible.
- Hiring the most in California
- SpaceX43 open
- Apple19 open
- Palo Alto Networks17 open
- Experience
- Site Reliability Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 5 to 8 years (1,831 postings).
- Education
- 454 of the 2,231 open Site Reliability Engineer jobs (20%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 17, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.