Senior Systems Engineer - AI Infrastructure
Palo Alto, CAJob$150–210K/yrSeen 4mo agoStill listed 4 days ago
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near Palo Alto, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Job overview
Clockwork Systems is building fault-tolerant, high-performance infrastructure for distributed GPU training. The Senior Systems Engineer will design and implement systems spanning GPU systems, high-speed networking, and distributed coordination, working with framework internals and building components to improve training reliability and efficiency. The role involves investigating complex failures and owning systems from design through production.
Skills & qualifications
Skills
Qualifications
Full job description
About Clockwork Systems
Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization
Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination. Clockwork is pioneering a software-driven approach to AI fabrics by delivering cross-stack observability to catch and quickly resolve problems, workload fault tolerance to keep jobs running through failures, and performance acceleration that dynamically routes and paces traffic to avoid congestion.
To learn more, visit www.clockwork.io.
About the Role
We're building infrastructure for fault-tolerant, high-performance distributed GPU training. You'll work at the intersection of GPU systems, high-speed networking, and distributed coordination—designing and implementing systems that run at scale.
This is a systems building role. You'll dig into internals, understand why things break under pressure, and design solutions that handle the messy reality of distributed systems.
What You'll Do
-
Design and implement low-level systems software for GPU clusters
-
Work with internals of frameworks like PyTorch, NCCL, CUDA runtime—not as a user, but modifying and extending them
-
Build components that make large-scale GPU training more reliable and efficient
-
Debug complex distributed/concurrent systems where failures are subtle and non-deterministic
-
Own systems end-to-end: from design through production
What We're Looking For
Required: Systems building experience
You've designed and built complex systems—not just deployed or operated them. Examples:
-
Kernel subsystems, device drivers, or OS-level components
-
Distributed storage, databases, or coordination systems
-
Runtimes, profilers, or performance tooling
-
Network stacks, protocols, or high-performance I/O systems
-
Large-scale infrastructure at the systems layer
Core technical skills:
-
Strong C/C++ in systems contexts
-
Deep understanding of concurrency, memory models.
-
Experience reasoning about distributed system behavior: consistency, ordering, partial failures
-
Comfortable reading and modifying large, unfamiliar codebases
Nice to have:
-
GPU programming (CUDA) or GPU systems experience
-
High-performance networking (RDMA, InfiniBand)
-
ML framework or runtime internals
-
Cluster scheduling or orchestration systems
We believe strong systems engineers pick up domain-specific tools quickly. We value your ability to reason about complex systems over checkbox familiarity with our specific stack.
Enjoy
-
Challenging projects.
-
A friendly and inclusive workplace culture.
-
Competitive compensation.
-
A great benefits package.
-
Catered lunch.
Compensation for this position will vary based on the skills and experience you bring, as well as internal equity considerations. For candidates hired at the posted level, the expected base salary range is $150,000 - $210,000. In addition to cash compensation, this role is eligible to participate in the company’s equity program, which may include stock options granted in accordance with the company’s equity plan and subject to approval and applicable vesting schedules. Clockwork Systems is an equal opportunity employer. We are committed to building world-class teams by welcoming bright, passionate individuals from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, religion, age, sex, sexual orientation, gender identity or expression, national origin, disability, or protected veteran status. We believe diversity drives innovation, and we grow stronger together.
How this job compares
Set against the 11,015 open Systems Engineer jobs on Olive Jobs, counted November 16, 2026.
- Pay
- This posting$150–210K/yr
- California median$140–208K/yr1,709 salary ranges
- US median$115–187K/yr8,549 salary ranges
This range's midpoint, $180K, is 4% above the California median midpoint ($173K) — in the middle half of Systems Engineer salary ranges in California.
- Openings
- Olive Jobs lists 1,979 open Systems Engineer jobs in California and 11,015 across the US. 5% of them nationwide are listed as remote or flexible.
- Hiring the most in California
- Northrop Grumman196 open
- Anduril160 open
- The Boeing Company103 open
- Experience
- Systems Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 3 to 8 years (9,242 postings).
- Education
- 4,097 of the 11,015 open Systems Engineer jobs (37%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 16, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.

