Senior/Staff AI Infrastructure Engineer
San Francisco, CAJob$180–250K/yrPosted 1mo agoStill listed today
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Echelon is building an AI platform for Business Operations and seeks an engineer to build the secure execution substrate for its agents. The role focuses on scaling ephemeral sandboxes, improving filesystem and startup performance, and making long-running agent work durable while preserving tenant isolation and operational control. Engineers work directly with founders and customers, ship production systems, and own results in a fast-changing environment.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
About Echelon Echelon is building the AI platform for Business Operations. Our goal is to automate the knowledge work of BizOps so one exceptional operator can deliver the leverage of an entire team, as Ramp and Rippling have done for Finance and HR. Our platform combines passive process mining with a living ontology that maps how work happens across people, systems, documents, decisions, and outcomes. It connects structured and unstructured data trapped in fragmented, duplicative, and legacy enterprise systems, then turns that context into automated workflows and AI agents. We are an early-stage company tackling a difficult technical problem at high speed. Engineers work directly with founders and customers, make decisions with incomplete information, ship production systems, and own the results. The pace, rate of change, and standards are high.
The mandate Build the secure execution substrate for Echelon's agents. You will scale ephemeral sandboxes, optimize filesystem and startup performance, and make long-running agent work durable under load without weakening tenant isolation or operational control.
What you'll own
-
Design and operate sandbox lifecycle systems for agent code execution, browser work, document processing, and tool use.
-
Improve sandbox startup time, density, scheduling, warm pools, caching, and resource utilization.
-
Build fast, reliable filesystem primitives for ephemeral and persistent agent state, large artifacts, and concurrent workloads.
-
Enforce tenant isolation, network policy, secrets boundaries, quotas, and least-privilege access.
-
Make long-running agent jobs durable through checkpointing, retries, idempotency, cancellation, and recovery.
-
Scale orchestration and control-plane services through rapid workload growth and unpredictable bursts.
-
Build observability for resource pressure, execution failures, queue health, noisy neighbors, cost, and end-to-end latency.
-
Run load tests, capacity plans, failure drills, and incident reviews; fix root causes rather than adding fragile workarounds.
What you bring
-
5+ years building production infrastructure, distributed systems, developer platforms, or execution runtimes.
-
Hands-on ownership of containerized or virtualized workloads in a multi-tenant production environment.
-
Strong Linux systems knowledge across processes, filesystems, networking, resource isolation, and performance debugging.
-
Experience with Kubernetes or a comparable scheduler, infrastructure as code, and cloud primitives on AWS or Azure.
-
Strong programming ability in Go, Rust, TypeScript, Python, or another systems-oriented language.
-
Experience designing for retries, idempotency, backpressure, load shedding, observability, and safe rollouts.
-
Security instincts appropriate for executing untrusted or model-generated work.
Useful experience
-
Firecracker, gVisor, Kata Containers, namespaces/cgroups, seccomp, or eBPF.
-
Sandbox products such as E2B, Modal, Fly Machines, or custom ephemeral compute platforms.
-
FUSE, overlay filesystems, content-addressed storage, snapshotting, distributed caches, or object storage.
-
Agent runtimes, code interpreters, browser automation, remote development environments, or CI execution systems.
-
BYOC, private networking, customer-managed deployments, or enterprise security reviews.
-
Inngest, Temporal, Kafka, NATS, or other durable workflow and event systems.
Benefits
-
Team lunches and dinners in the office.
-
On-site Gym access for all employees.
-
Fully covered health, dental, and vision insurance.
-
401(k) plan.
-
Access to AI Tooling of your choice.
-
Unlimited PTO.
How this job compares
Set against the 4,546 open Infrastructure Engineer jobs on Olive Jobs, counted October 30, 2026.
- Pay
- This posting$180–250K/yr
- California median$170–252K/yr721 salary ranges
- US median$123–220K/yr3,736 salary ranges
This range's midpoint, $215K, is close to the California median midpoint ($213K) — in the middle half of Infrastructure Engineer salary ranges in California.
- Openings
- Olive Jobs lists 941 open Infrastructure Engineer jobs in California and 4,546 across the US. 8% of them nationwide are listed as remote or flexible.
- Experience
- This posting asks for at least 5 years of experience; Infrastructure Engineer postings that state a minimum ask for 6 years at the median (3,501 postings).
- Education
- 1,022 of the 4,546 open Infrastructure Engineer jobs (22%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on October 30, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
AI Infrastructure EngineerEchelon AI · Remote · USPosted 1 day agoPosted 1 day ago
Infrastructure Software Engineerdepthfirst · San Francisco, CAPosted 1w agoPosted 1w ago
AI Infrastructure EngineerMercor · San Francisco, CA · $200–400K/yrPosted 2 days agoPosted 2 days agoInfrastructure EngineerSimple AI · San Francisco, CA · $140–250K/yr
Infrastructure Software Engineer (AI Enablement)LatchBio · San Francisco, CA · $170–250K/yrPosted 2w agoPosted 2w ago
You've read the whole posting — now see how you match it.